-- Logs begin at Fri 2022-06-17 14:24:08 UTC, end at Fri 2022-06-17 15:32:32 UTC. -- Jun 17 14:57:50.804583 dv-cinder-825492-23-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 17 14:57:50.815045 dv-cinder-825492-23-smb devstack@keystone.service[80322]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 14:57:50 2022] *** Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: nodename: dv-cinder-825492-23-smb Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: machine: x86_64 Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: clock source: unix Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: pcre jit disabled Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: detected number of CPU cores: 4 Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: current working directory: / Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: detected binary path: /usr/bin/uwsgi-core Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: your processes number limit is 47680 Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: your memory page size is 4096 bytes Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: detected max file descriptor number: 2048 Jun 17 14:57:50.817242 dv-cinder-825492-23-smb devstack@keystone.service[80322]: lock engine: pthread robust mutexes Jun 17 14:57:50.818084 dv-cinder-825492-23-smb devstack@keystone.service[80322]: thunder lock: enabled Jun 17 14:57:50.818084 dv-cinder-825492-23-smb devstack@keystone.service[80322]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 17 14:57:50.818084 dv-cinder-825492-23-smb devstack@keystone.service[80322]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 14:57:50.864315 dv-cinder-825492-23-smb devstack@keystone.service[80322]: Python main interpreter initialized at 0x5570ad8fe9c0 Jun 17 14:57:50.864315 dv-cinder-825492-23-smb devstack@keystone.service[80322]: python threads support enabled Jun 17 14:57:50.864315 dv-cinder-825492-23-smb devstack@keystone.service[80322]: your server socket listen backlog is limited to 100 connections Jun 17 14:57:50.864315 dv-cinder-825492-23-smb devstack@keystone.service[80322]: your mercy for graceful operations on workers is 90 seconds Jun 17 14:57:50.864658 dv-cinder-825492-23-smb devstack@keystone.service[80322]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 14:57:50.864731 dv-cinder-825492-23-smb devstack@keystone.service[80322]: *** Operational MODE: preforking *** Jun 17 14:57:50.865005 dv-cinder-825492-23-smb devstack@keystone.service[80322]: *** uWSGI is running in multiple interpreter mode *** Jun 17 14:57:50.865005 dv-cinder-825492-23-smb devstack@keystone.service[80322]: spawned uWSGI master process (pid: 80322) Jun 17 14:57:50.865240 dv-cinder-825492-23-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 17 14:57:50.867104 dv-cinder-825492-23-smb devstack@keystone.service[80322]: spawned uWSGI worker 1 (pid: 80332, cores: 1) Jun 17 14:57:50.867104 dv-cinder-825492-23-smb devstack@keystone.service[80322]: spawned uWSGI worker 2 (pid: 80333, cores: 1) Jun 17 14:57:50.867104 dv-cinder-825492-23-smb devstack@keystone.service[80322]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 14:57:56.493699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 14:57:56.493699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: from cryptography.utils import int_from_bytes Jun 17 14:57:56.494547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 14:57:56.494547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: from cryptography.utils import int_from_bytes Jun 17 14:57:56.499749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 14:57:56.499749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: from cryptography.utils import int_from_bytes Jun 17 14:57:56.500261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 14:57:56.500261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: from cryptography.utils import int_from_bytes Jun 17 14:57:56.546711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 14:57:56.546910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 14:57:56.547056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] command line args: [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 14:57:56.547365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 14:57:56.547520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ================================================================================ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 14:57:56.547788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] admin_token = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.548048 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config_dir = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.548264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.548421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config_source = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.548622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] debug = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.548823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.550716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.550716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.550716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.550716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.550716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.550716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_config_append = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.550716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.550716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_dir = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.550716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.551198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 14:57:56.551265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.551329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 14:57:56.551386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.551446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] command line args: [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 14:57:56.551507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.551568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 14:57:56.551669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ================================================================================ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 14:57:56.551841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.551841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.552052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] admin_token = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.552144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.552250 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config_dir = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.552358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.552434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.552544 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.552635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config_source = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.552710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] debug = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.552836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.552921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.553058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.553144 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.553258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.553370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.553461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.553584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.553665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.553735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.553873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.553991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.554132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_config_append = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.554221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.554282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.554456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_dir = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.554644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.554824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.554824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] publish_errors = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.555132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.555233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.555422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.555628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.555791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.555953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.556088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.556253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.556420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.556594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.556730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.556894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] standard_threads = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.557029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.557195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.557408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.557530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.557671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.557779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.557886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.558023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_journal = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.558142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.558256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_json = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.558256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_stderr = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.558464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.558590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_syslog = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.558738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.558850 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.558975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.559085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.559199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.559457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.559457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.559704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.559798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.559879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] publish_errors = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.559956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.560057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.560132 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.560202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.560202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.560327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.560396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.560396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.560524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.560596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] standard_threads = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.560664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.560739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.560803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.560870 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.560937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.561004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.561071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_journal = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.561147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.561249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_json = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.561438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.561565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_stderr = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.561565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_syslog = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.561705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.561789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 14:57:56.561934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.562055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.562130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.562302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.562422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.562516 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.562622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.562772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.562921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.563042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.563116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.563223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.563392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.563522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.563599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.563693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.563899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.564106 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.564187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.564262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.564409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.564530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.564605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.564691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.564860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.564983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.565058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.565137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.565350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.565490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.565568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.565637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.565816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.565947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.566024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.566103 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.566285 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.566405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.566507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.566589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.566772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.566905 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.566983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.567051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.567248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.567379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.567456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.567536 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.567712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.567833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.567909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.567977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.568168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.568296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.568374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.568442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.568618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.568738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.568831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.568910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.569069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.569195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.569310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.569379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.569536 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.569610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.569774 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.569905 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.569981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.570049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.570240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.570360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.570435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.570503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.570702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.570828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.570922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.570993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.571156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.571284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.571362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.571431 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.571594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.571715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.571791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.571860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.572040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.572160 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.572252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.572325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.572501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.572615 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.572701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.572804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.572958 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.573029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.573185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.573278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.573440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.573541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.573647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.573743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.573892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.574006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.574141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.574252 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.574367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.574508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.574612 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.574726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.574863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.575244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.575478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.575478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.575756 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.575934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.576072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.576194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.576306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.576526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.576994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.577154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.577293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.577493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.577664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.577811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.578002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.578116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.578279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.578396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.578509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.578665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.578789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.578900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579093 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579204 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.579962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.580935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.581037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.581136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.581267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.581364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.581471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.581627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.581729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.581838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.581921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.581921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.582409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.582501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.582582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.582663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.582740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.582810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.582874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.582942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.583011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.583082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.583151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.583215 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.583284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.583487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.583610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.583704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.583778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.583940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.584112 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.external = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.584228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.584303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.584379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.584451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.584597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.584720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.584797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.584878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.password = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.585055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.585178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.token = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.585425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.585507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.585573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.585658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.585757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.585913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.586050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.586130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.586261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.586351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.586454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.external = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.586619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.586743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.586823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.586986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.587111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.587176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.587279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.587402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.password = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.587559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.587683 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.token = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.587786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.587876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.588047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.588171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.588275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.588372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.588551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.588673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.588752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.588814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.589005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.589138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.589310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.589391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.589463 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.589525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.589682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.589850 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.589993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.590147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.590305 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.590447 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.590584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.590723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.590856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.590856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.591135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.591254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.591389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.591529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.591719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.591857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.592010 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.592162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.592295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.592424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.592550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.592684 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.592827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.592963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.593088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.593260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.593391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.593520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.593673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.593818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.593952 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.594084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.594215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.594345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.594488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.594613 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.594740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.594872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.594872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.595228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.595377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.595508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.595638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.595779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.595922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.596046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.596302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.596302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.596529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.596656 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.596773 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.596869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.596944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.597014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.597083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.597153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.597153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.597319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.597394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.597553 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.597691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.597826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.597964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.598118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.598257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.598397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.598484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.598557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.598773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.598909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.598992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.599065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.599236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.599361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.599439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.599637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.599762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.599927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.600050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.600130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.600203 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.600401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.600520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.600624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.600721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.600883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.601018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.601109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.601342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.601468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.601621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.601744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.601824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.601915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.602104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.602230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.602309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.602496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.602621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.602793 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.602926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.603007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.603079 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.603236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.603320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.603483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.603620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.603703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.603875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.603958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.604141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.604233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.604431 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.604513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.604662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.604744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.604895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.604986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.605150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.605262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.605420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.605582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.605679 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.605888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.605970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.606111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.606245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.606644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.606743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.606941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.607188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.607371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.607537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.607629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.607763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.607971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.608054 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.608126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.608310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.608400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.608556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.608645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.608875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.608967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.609041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.609199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.609302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.609542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.609634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.609749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.609898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.609982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.610072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.610277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.610373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.610469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.610634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.610725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.610919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.611001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.611217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.611310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.611404 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.611482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.611645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.611721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.611916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.612007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.612121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.612345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.612432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.612591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.612723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.612845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.612966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.613088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.613444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.613576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.613807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.613937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.614065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.614329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.614483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.614648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.614776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.614905 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.615024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.615142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.615275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.615388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.615504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.615621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.615737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.615854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.615981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.616093 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.616210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.616327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.616447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.616563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.616697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.616825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.616941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.616941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.617159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.617291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.617434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.617556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.617676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.617796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.617916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.618036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.618171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.618285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.618406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.618525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.618646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.618765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.618896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.619012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.619131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.619248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.619367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.619486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.619617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.619732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.619858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.619978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.620097 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.620216 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.620347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.620463 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.620584 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.620702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.620864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.620974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.621280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.621392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.621526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.621640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.621756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.621869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.621990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.622095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.622212 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.622340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.622452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.622562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.622681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.622792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.622908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.623025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.623025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.623025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.623625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.623742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.623859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.623975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.623975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.624203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.624315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.624431 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.624550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.624664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.624780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.624908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.625028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.625144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.625279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.625279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.625497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.625630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.625747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.625868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.625989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.626108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.626226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.626362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.626476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.626603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.626723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.626845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.626845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.627072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.627185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.627307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.627426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.627545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.627667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.627799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.627915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.628037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.628155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.628272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.628388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.628521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.628636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.628755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.628873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.628873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.629088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.629255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.629369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.629488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.629601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.629717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.629855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.629966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.630082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.630199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.630199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.630416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.630547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.630662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.630776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.630776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.630991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.631105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.631233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.631349 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.631471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.631594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.631704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.631821 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.631948 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.632100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.632216 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.632331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.632447 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.632563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.632769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.632920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.633048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.633171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.633319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.633478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.633697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.633697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.633911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.634039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.634164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.634278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.634398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.634515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.634657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.634823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.634937 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.635063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.635178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.635295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.635425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.635542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.635722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.635836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.635966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.636089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.636255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.636379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.636493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.636604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.636721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.636845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.636964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.637095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.637271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.637444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.637567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.637680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.637926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.638161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.638299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.638413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.638589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.638702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.638857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.638982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.639095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.639213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.639329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.639454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.639568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.639731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.639845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.639963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 14:57:56.640080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 14:57:56.640197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 14:57:56.760214 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.760417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.760576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.761076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.761313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.761543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.769127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.770709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.800543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.800776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.801027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.801241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.856011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.860161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.908275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.908514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.908918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.909154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.975261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.975566 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.975644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.975845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.976100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.976191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.976255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.976316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.976503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.976591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.976663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:56.976935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.000723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.000940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.001158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.001410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.001626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.001840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.001965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.002068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.002146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.002263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.002504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.002715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.002927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.003135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.013517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.014108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.026096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.026268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.026351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.026516 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.026641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.026721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.026796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.026904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.026991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.027405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.027530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.027610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.027698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.027698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 14:57:57.044818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.044974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 14:57:57.045367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.045512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.045597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 14:57:57.045671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 14:57:57.045788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.045951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.046077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.046170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 14:57:57.046278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.046356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.046553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.046678 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.046886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.047137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.057239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.057535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.057802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.058007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.058150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.058255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.058551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.058833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.066325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.067780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.069648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.069928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.070204 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.070479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.070751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.071000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.071123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.071237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.071403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.071528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.071659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.071751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.071963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.072089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.072239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.072378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.072461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.072737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.072991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.073280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.073548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.073812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.099266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.100871 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.101124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.101927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.103547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.103828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.106529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.106916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.107190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.109724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.110115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.110397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.114476 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.114747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.117744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.118023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.119181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.119462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.119736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.120008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.120275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.120540 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.120858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.121148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.123173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.123458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.123737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.124020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.124287 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.124590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.124862 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.125111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.143696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.144005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.144718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.144999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.148567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.149555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.152215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.152599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.153513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.154373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.157790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.159483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.161467 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.163261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.165240 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.165538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.165821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.166093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.166370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.166650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.166944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.167244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.167520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.167786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.168067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.168346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.186167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.186443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.186702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.186965 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.188693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.188982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.189273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.189530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.194829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.196529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.196809 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.197446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.199164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.199438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.201885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.202167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.202427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.202714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.203051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.205037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.205300 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.205623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.205857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.206162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.216237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.216504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.216776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.217047 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.217440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.217707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.217976 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.220068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.220346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.220626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.220904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.221336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.221669 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.221847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.235942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.239230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.240512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.242538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.243883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.244283 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.245928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.246211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.246483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.247766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.249557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.251210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.251484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.251759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.255031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.256888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.259103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.260702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.260828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.261078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.261541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.261876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.264688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.264918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.265341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.265615 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.271977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.272269 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.272537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.274865 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.275149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.275430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.280431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.280708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.280993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.281279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.281552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.281941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.282209 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.282477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.282747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.283004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.283268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.283526 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.283786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.283901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 14:57:57.284036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.284189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.284465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.284740 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.284993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.285410 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.285690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.285968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.286234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.286507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.286788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.287054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.287321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.287585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 14:57:57.321917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5570ad8fe9c0 pid: 80332 (default app) Jun 17 14:57:57.325552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28b8b0-8e8c-4c9e-8f12-fb78fcc09b67 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:57:57.325843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28b8b0-8e8c-4c9e-8f12-fb78fcc09b67 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:57:57.326120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28b8b0-8e8c-4c9e-8f12-fb78fcc09b67 None None] PATH_INFO: `/v3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:57:57.327691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5570ad8fe9c0 pid: 80333 (default app) Jun 17 14:57:57.330711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Fri Jun 17 14:57:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:05.339769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997b82b-bb96-40f1-aea5-9026e90ebb5d None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:05.340489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997b82b-bb96-40f1-aea5-9026e90ebb5d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:05.340489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997b82b-bb96-40f1-aea5-9026e90ebb5d None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:05.345534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:58:05.350897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:05.351342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:05.351431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:05.423596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: INFO dbcounter [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] Registered counter for database keystone Jun 17 14:58:05.446484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG oslo_db.sqlalchemy.engines [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 14:58:05.455503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writer thread running {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 14:58:05.653016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG passlib.handlers.bcrypt [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80332) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 14:58:05.653357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG passlib.handlers.bcrypt [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80332) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 14:58:05.708004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:05.709666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:05.849580 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 17 14:58:05.993470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997b82b-bb96-40f1-aea5-9026e90ebb5d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:06.073912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: INFO dbcounter [None req-9997b82b-bb96-40f1-aea5-9026e90ebb5d None None] Registered counter for database keystone Jun 17 14:58:06.095723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG oslo_db.sqlalchemy.engines [None req-9997b82b-bb96-40f1-aea5-9026e90ebb5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 14:58:06.103322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writer thread running {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 14:58:06.225026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997b82b-bb96-40f1-aea5-9026e90ebb5d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:06.229744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09474f1-d7df-4523-b6e3-eef1511ed947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:06.230419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09474f1-d7df-4523-b6e3-eef1511ed947 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:06.230691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09474f1-d7df-4523-b6e3-eef1511ed947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:06.230977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09474f1-d7df-4523-b6e3-eef1511ed947 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:06.239552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09474f1-d7df-4523-b6e3-eef1511ed947 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:06.291302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c09474f1-d7df-4523-b6e3-eef1511ed947 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 14:58:06.291506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09474f1-d7df-4523-b6e3-eef1511ed947 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:06.302096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Fri Jun 17 14:58:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 14:58:06.308968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:06.327706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c3af-9e56-4ab7-a113-d4ed27e818fe None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:06.332974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5856b0-dc48-4675-8736-8e62943c567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:06.334155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5856b0-dc48-4675-8736-8e62943c567d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:06.334427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5856b0-dc48-4675-8736-8e62943c567d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:06.334711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5856b0-dc48-4675-8736-8e62943c567d admin admin] PATH_INFO: `/v3/projects/2862ed4e06e54fce9d45a21ed40f7a44` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:06.336352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5856b0-dc48-4675-8736-8e62943c567d admin admin] RBAC: Authorizing `identity:get_project(project_id=2862ed4e06e54fce9d45a21ed40f7a44)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:06.389847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eb5856b0-dc48-4675-8736-8e62943c567d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 14:58:06.390468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5856b0-dc48-4675-8736-8e62943c567d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:06.394960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Fri Jun 17 14:58:06 2022] GET /identity/v3/projects/2862ed4e06e54fce9d45a21ed40f7a44 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:08.483017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab53ae-df1b-4100-b0ca-dc1afc8c3222 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:08.483562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab53ae-df1b-4100-b0ca-dc1afc8c3222 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:08.483562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab53ae-df1b-4100-b0ca-dc1afc8c3222 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:08.487690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:08.493340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13b995-76d0-470b-88b3-b6d605ac0275 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:08.493751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13b995-76d0-470b-88b3-b6d605ac0275 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:08.493875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13b995-76d0-470b-88b3-b6d605ac0275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:08.514558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9d13b995-76d0-470b-88b3-b6d605ac0275 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:08.516133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9d13b995-76d0-470b-88b3-b6d605ac0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:08.525635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 17 14:58:08.549649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab53ae-df1b-4100-b0ca-dc1afc8c3222 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:08.563510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab53ae-df1b-4100-b0ca-dc1afc8c3222 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:08.568238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf24a3-72d7-47c2-9c60-09ebe55c759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:08.568880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf24a3-72d7-47c2-9c60-09ebe55c759d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:08.569164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf24a3-72d7-47c2-9c60-09ebe55c759d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:08.569488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf24a3-72d7-47c2-9c60-09ebe55c759d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:08.581491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf24a3-72d7-47c2-9c60-09ebe55c759d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:08.583341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf24a3-72d7-47c2-9c60-09ebe55c759d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:08.593270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Fri Jun 17 14:58:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 14:58:08.599149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13b995-76d0-470b-88b3-b6d605ac0275 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:08.609256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13b995-76d0-470b-88b3-b6d605ac0275 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:08.615076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8decb49-39e2-4adf-a640-1b5ffaab99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:08.615979 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8decb49-39e2-4adf-a640-1b5ffaab99fc admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:08.616261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8decb49-39e2-4adf-a640-1b5ffaab99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:08.616543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8decb49-39e2-4adf-a640-1b5ffaab99fc admin admin] PATH_INFO: `/v3/users/a2fa31ddd5e14c2dba5028b21c5db486` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:08.618136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8decb49-39e2-4adf-a640-1b5ffaab99fc admin admin] RBAC: Authorizing `identity:get_user(user_id=a2fa31ddd5e14c2dba5028b21c5db486)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:08.620031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8decb49-39e2-4adf-a640-1b5ffaab99fc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:08.621898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Fri Jun 17 14:58:08 2022] GET /identity/v3/users/a2fa31ddd5e14c2dba5028b21c5db486 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:10.853233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945fec0-a5bb-495d-9006-1be11b94be4b None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:10.853893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945fec0-a5bb-495d-9006-1be11b94be4b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:10.853893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945fec0-a5bb-495d-9006-1be11b94be4b None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:10.855272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:10.856671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1bc7d-3ef2-4304-bdd4-5f3e18a86f20 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:10.857140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1bc7d-3ef2-4304-bdd4-5f3e18a86f20 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:10.857268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1bc7d-3ef2-4304-bdd4-5f3e18a86f20 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:10.858754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:58:10.861188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640c1cc-ba67-4504-90db-8042f92e0056 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:10.861589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640c1cc-ba67-4504-90db-8042f92e0056 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:10.861929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640c1cc-ba67-4504-90db-8042f92e0056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:10.863736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06644b4-0ca2-4f4f-94ff-371e22cbc8eb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:10.864002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06644b4-0ca2-4f4f-94ff-371e22cbc8eb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:10.864294 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06644b4-0ca2-4f4f-94ff-371e22cbc8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:10.882847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f06644b4-0ca2-4f4f-94ff-371e22cbc8eb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:10.884153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f06644b4-0ca2-4f4f-94ff-371e22cbc8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:10.904906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG passlib.handlers.bcrypt [None req-5640c1cc-ba67-4504-90db-8042f92e0056 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80333) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 14:58:10.905398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG passlib.handlers.bcrypt [None req-5640c1cc-ba67-4504-90db-8042f92e0056 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80333) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 14:58:10.951445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5640c1cc-ba67-4504-90db-8042f92e0056 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:10.953484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5640c1cc-ba67-4504-90db-8042f92e0056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:10.975596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 7/12] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:10.999361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06644b4-0ca2-4f4f-94ff-371e22cbc8eb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:11.024909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:11.059947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 6/13] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:11.083880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640c1cc-ba67-4504-90db-8042f92e0056 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:11.114833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06644b4-0ca2-4f4f-94ff-371e22cbc8eb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:11.153222 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7d03a-0596-448a-9933-97005a9ec9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:11.153928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d03a-0596-448a-9933-97005a9ec9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:11.154285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d03a-0596-448a-9933-97005a9ec9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:11.154517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d03a-0596-448a-9933-97005a9ec9a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:11.200439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640c1cc-ba67-4504-90db-8042f92e0056 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:11.204458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:11.242775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7d03a-0596-448a-9933-97005a9ec9a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:11.244307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7d03a-0596-448a-9933-97005a9ec9a6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:11.251158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3e36c-2e6b-4a1a-903f-94ac5a1b764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:11.252866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3e36c-2e6b-4a1a-903f-94ac5a1b764e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:11.253358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3e36c-2e6b-4a1a-903f-94ac5a1b764e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:11.253797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3e36c-2e6b-4a1a-903f-94ac5a1b764e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:11.269691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:11.272276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3e36c-2e6b-4a1a-903f-94ac5a1b764e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8af3e36c-2e6b-4a1a-903f-94ac5a1b764e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:11.291733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:11.292683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:11.293577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:11.294168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:11.302626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3e36c-2e6b-4a1a-903f-94ac5a1b764e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:11.359211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 8/15] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 14:58:11.364882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7d03a-0596-448a-9933-97005a9ec9a6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:11.410019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3e36c-2e6b-4a1a-903f-94ac5a1b764e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:11.447300 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff163f-3999-4b9f-8bde-5fb18308f458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:11.447969 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff163f-3999-4b9f-8bde-5fb18308f458 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:11.448253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff163f-3999-4b9f-8bde-5fb18308f458 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:11.448518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff163f-3999-4b9f-8bde-5fb18308f458 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:11.449315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff163f-3999-4b9f-8bde-5fb18308f458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:11.449840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff163f-3999-4b9f-8bde-5fb18308f458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:11.451464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff163f-3999-4b9f-8bde-5fb18308f458 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:11.466862 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 8/16] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:11.471500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7d03a-0596-448a-9933-97005a9ec9a6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:11.472692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff163f-3999-4b9f-8bde-5fb18308f458 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:11.502148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:11.506572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:11.516439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818829e-88c4-47e0-ad36-539b4ced382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:11.517300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818829e-88c4-47e0-ad36-539b4ced382d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:11.517590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818829e-88c4-47e0-ad36-539b4ced382d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:11.517873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818829e-88c4-47e0-ad36-539b4ced382d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:11.530378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818829e-88c4-47e0-ad36-539b4ced382d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:11.532029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818829e-88c4-47e0-ad36-539b4ced382d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0818829e-88c4-47e0-ad36-539b4ced382d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:58:11.553484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:11.554453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:11.555823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:58:11.555823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:58:11.555823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:58:11.555823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:11.555823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:58:11.560982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818829e-88c4-47e0-ad36-539b4ced382d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:11.587474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff163f-3999-4b9f-8bde-5fb18308f458 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:11.625945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376dc50-4f10-4eeb-b91c-9e539a4e2b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:11.626845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376dc50-4f10-4eeb-b91c-9e539a4e2b4e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:11.627191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376dc50-4f10-4eeb-b91c-9e539a4e2b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:11.627537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376dc50-4f10-4eeb-b91c-9e539a4e2b4e None admin] PATH_INFO: `/v3/users/a2fa31ddd5e14c2dba5028b21c5db486` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:11.629361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376dc50-4f10-4eeb-b91c-9e539a4e2b4e None admin] RBAC: Authorizing `identity:get_user(user_id=a2fa31ddd5e14c2dba5028b21c5db486)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:11.631004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376dc50-4f10-4eeb-b91c-9e539a4e2b4e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:11.632891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:11 2022] GET /identity/v3/users/a2fa31ddd5e14c2dba5028b21c5db486 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:11.638692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376dc50-4f10-4eeb-b91c-9e539a4e2b4e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:11.668917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818829e-88c4-47e0-ad36-539b4ced382d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:11.708022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c60021-c851-46ca-a2e6-12361e08ad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:11.708022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60021-c851-46ca-a2e6-12361e08ad5e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:11.708022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60021-c851-46ca-a2e6-12361e08ad5e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:11.708022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60021-c851-46ca-a2e6-12361e08ad5e None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:11.708670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c60021-c851-46ca-a2e6-12361e08ad5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:11.708834 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c60021-c851-46ca-a2e6-12361e08ad5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:11.710272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c60021-c851-46ca-a2e6-12361e08ad5e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:11.728738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:11.740791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:11.749642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376dc50-4f10-4eeb-b91c-9e539a4e2b4e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:11.790006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d7fb2-49e3-4115-ab8e-83d93f4d1b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:11.791065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7fb2-49e3-4115-ab8e-83d93f4d1b9f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:11.791463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7fb2-49e3-4115-ab8e-83d93f4d1b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:11.791841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7fb2-49e3-4115-ab8e-83d93f4d1b9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:11.793568 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d7fb2-49e3-4115-ab8e-83d93f4d1b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:11.795759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d7fb2-49e3-4115-ab8e-83d93f4d1b9f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:11.797802 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:11.803927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c60021-c851-46ca-a2e6-12361e08ad5e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:11.846574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:11.925741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c60021-c851-46ca-a2e6-12361e08ad5e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:11.975417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78133b0-2641-4c36-b904-58bb8893e154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:11.976808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78133b0-2641-4c36-b904-58bb8893e154 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:11.977200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78133b0-2641-4c36-b904-58bb8893e154 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:11.977609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78133b0-2641-4c36-b904-58bb8893e154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:11.979074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78133b0-2641-4c36-b904-58bb8893e154 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.domain.id=default, user.id=a2fa31ddd5e14c2dba5028b21c5db486) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:11.979576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78133b0-2641-4c36-b904-58bb8893e154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:11.982370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78133b0-2641-4c36-b904-58bb8893e154 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:11.994032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 11/21] 10.222.0.45 () {56 vars in 1322 bytes} [Fri Jun 17 14:58:11 2022] GET /identity/v3/role_assignments?user.id=a2fa31ddd5e14c2dba5028b21c5db486&scope.domain.id=default&role.id=8a6fe5045159487aa0119348cfe94387 => generated 233 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:14.829954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a588-51f8-4d38-8610-71b88c840aca None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:14.830710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a588-51f8-4d38-8610-71b88c840aca None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:14.830710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a588-51f8-4d38-8610-71b88c840aca None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:14.831866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:58:14.839492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470bab0-d76f-4df8-9828-01f607ab3bd9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:14.840210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470bab0-d76f-4df8-9828-01f607ab3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:14.840210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470bab0-d76f-4df8-9828-01f607ab3bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:14.862903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e470bab0-d76f-4df8-9828-01f607ab3bd9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:14.864178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e470bab0-d76f-4df8-9828-01f607ab3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:14.957923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:15.019947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a588-51f8-4d38-8610-71b88c840aca None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:15.148386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a588-51f8-4d38-8610-71b88c840aca None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:15.192935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570185c-c76c-4981-acfd-1986fb01fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:15.193619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570185c-c76c-4981-acfd-1986fb01fb53 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:15.193903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570185c-c76c-4981-acfd-1986fb01fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:15.194185 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570185c-c76c-4981-acfd-1986fb01fb53 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:15.194936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570185c-c76c-4981-acfd-1986fb01fb53 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:15.196336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570185c-c76c-4981-acfd-1986fb01fb53 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:15.342559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 12/24] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Jun 17 14:58:15 2022] POST /identity/v3/roles => generated 219 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 14:58:15.639879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ca92d-dff1-4591-80fe-00267d056d3c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:15.640403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ca92d-dff1-4591-80fe-00267d056d3c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:15.640853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ca92d-dff1-4591-80fe-00267d056d3c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:15.642421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 13/25] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:58:15.650476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae283d-5ec2-4cdf-9f1c-5d969fa494be None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:15.651028 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae283d-5ec2-4cdf-9f1c-5d969fa494be None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:15.651451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae283d-5ec2-4cdf-9f1c-5d969fa494be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:15.674418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c8ae283d-5ec2-4cdf-9f1c-5d969fa494be None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:15.676273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c8ae283d-5ec2-4cdf-9f1c-5d969fa494be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:15.700724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:15.768189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 13/26] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:15.833623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ca92d-dff1-4591-80fe-00267d056d3c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:15.872606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:15.958186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1d1cf-7c9f-4d5a-a226-3d46e005e292 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:15.958666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1d1cf-7c9f-4d5a-a226-3d46e005e292 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:15.958940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1d1cf-7c9f-4d5a-a226-3d46e005e292 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:15.961105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 14/27] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:58:15.990308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805bf96-3be5-4818-a986-dcdd784d6026 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:15.990743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805bf96-3be5-4818-a986-dcdd784d6026 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:15.991178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805bf96-3be5-4818-a986-dcdd784d6026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:16.030324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1805bf96-3be5-4818-a986-dcdd784d6026 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:16.032099 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1805bf96-3be5-4818-a986-dcdd784d6026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:16.036195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ca92d-dff1-4591-80fe-00267d056d3c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:16.104073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cae8c8-2337-4208-9c11-eb75a7841b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:16.105263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cae8c8-2337-4208-9c11-eb75a7841b64 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:16.105825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cae8c8-2337-4208-9c11-eb75a7841b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:16.106297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cae8c8-2337-4208-9c11-eb75a7841b64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:16.135127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cae8c8-2337-4208-9c11-eb75a7841b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-82cae8c8-2337-4208-9c11-eb75a7841b64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:16.149288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:16.150197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:16.150924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:16.156411 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 14/28] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:58:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:58:16.165315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cae8c8-2337-4208-9c11-eb75a7841b64 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:16.172479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 15/29] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 17 14:58:16.202422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805bf96-3be5-4818-a986-dcdd784d6026 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:16.346945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:16.353667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:16.371281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cae8c8-2337-4208-9c11-eb75a7841b64 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:16.386241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805bf96-3be5-4818-a986-dcdd784d6026 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:16.412375 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03517d-b644-410e-acd6-9ba5b505b115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:16.413427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03517d-b644-410e-acd6-9ba5b505b115 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:16.413915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03517d-b644-410e-acd6-9ba5b505b115 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:16.414382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03517d-b644-410e-acd6-9ba5b505b115 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:16.415366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03517d-b644-410e-acd6-9ba5b505b115 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:16.415869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03517d-b644-410e-acd6-9ba5b505b115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:16.417643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03517d-b644-410e-acd6-9ba5b505b115 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:16.433426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 15/30] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:16.435663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb7e2a-3ffd-4db0-a348-ab7effb8736f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:16.436198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb7e2a-3ffd-4db0-a348-ab7effb8736f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:16.436676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb7e2a-3ffd-4db0-a348-ab7effb8736f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:16.442682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 16/31] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:16.444847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d0120-6c6f-4da9-96dc-d8112026cd70 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:16.445184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d0120-6c6f-4da9-96dc-d8112026cd70 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:16.445754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d0120-6c6f-4da9-96dc-d8112026cd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:16.464014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6116e-8cbd-4c71-8c8f-0cf5ca5f7ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:16.464932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6116e-8cbd-4c71-8c8f-0cf5ca5f7ceb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:16.465272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6116e-8cbd-4c71-8c8f-0cf5ca5f7ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:16.465608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6116e-8cbd-4c71-8c8f-0cf5ca5f7ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:16.468004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ff2d0120-6c6f-4da9-96dc-d8112026cd70 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:16.469381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ff2d0120-6c6f-4da9-96dc-d8112026cd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:16.487696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6116e-8cbd-4c71-8c8f-0cf5ca5f7ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:16.489766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6116e-8cbd-4c71-8c8f-0cf5ca5f7ceb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5df6116e-8cbd-4c71-8c8f-0cf5ca5f7ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:58:16.509429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:16.510360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:16.511130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:58:16.511130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:58:16.511130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:58:16.511130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:16.516691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 16/32] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:16.516691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6116e-8cbd-4c71-8c8f-0cf5ca5f7ceb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:16.560474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 17/33] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:16.570385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d0120-6c6f-4da9-96dc-d8112026cd70 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:16.649174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6116e-8cbd-4c71-8c8f-0cf5ca5f7ceb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:16.674842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:16.695052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b979-0a65-452d-9606-ede27ddeb5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:16.696465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b979-0a65-452d-9606-ede27ddeb5bd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:16.696965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b979-0a65-452d-9606-ede27ddeb5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:16.697468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b979-0a65-452d-9606-ede27ddeb5bd None admin] PATH_INFO: `/v3/users/a2fa31ddd5e14c2dba5028b21c5db486` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:16.698875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370b979-0a65-452d-9606-ede27ddeb5bd None admin] RBAC: Authorizing `identity:get_user(user_id=a2fa31ddd5e14c2dba5028b21c5db486)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:16.699234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d0120-6c6f-4da9-96dc-d8112026cd70 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:16.701012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370b979-0a65-452d-9606-ede27ddeb5bd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:16.703713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 17/34] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:16 2022] GET /identity/v3/users/a2fa31ddd5e14c2dba5028b21c5db486 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:16.704674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b979-0a65-452d-9606-ede27ddeb5bd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:16.707731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:16.741508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1b63d-e9ad-4e84-9547-b02d9345074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:16.742196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1b63d-e9ad-4e84-9547-b02d9345074b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:16.742483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1b63d-e9ad-4e84-9547-b02d9345074b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:16.742761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1b63d-e9ad-4e84-9547-b02d9345074b None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:16.743668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1b63d-e9ad-4e84-9547-b02d9345074b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:16.743990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1b63d-e9ad-4e84-9547-b02d9345074b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:16.746069 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1b63d-e9ad-4e84-9547-b02d9345074b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:16.767850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 18/35] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:16.767850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1b63d-e9ad-4e84-9547-b02d9345074b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:16.910145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1b63d-e9ad-4e84-9547-b02d9345074b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:16.950319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4aac-8f86-4b62-8f73-944d98cc994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:16.951538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4aac-8f86-4b62-8f73-944d98cc994c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:16.952264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4aac-8f86-4b62-8f73-944d98cc994c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:16.952682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4aac-8f86-4b62-8f73-944d98cc994c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:16.954543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4aac-8f86-4b62-8f73-944d98cc994c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:16.956888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4aac-8f86-4b62-8f73-944d98cc994c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:16.959480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 19/36] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:16.960708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4aac-8f86-4b62-8f73-944d98cc994c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:16.967550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b979-0a65-452d-9606-ede27ddeb5bd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:16.978494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:17.004827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f5a1e-349a-45a4-a34d-2d4a23ada71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:17.005697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f5a1e-349a-45a4-a34d-2d4a23ada71a None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:17.006081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f5a1e-349a-45a4-a34d-2d4a23ada71a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:17.006470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f5a1e-349a-45a4-a34d-2d4a23ada71a None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:17.007430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f5a1e-349a-45a4-a34d-2d4a23ada71a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:17.009027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f5a1e-349a-45a4-a34d-2d4a23ada71a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:17.024609 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Jun 17 14:58:16 2022] POST /identity/v3/roles => generated 225 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:17.026796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ecb16-e57f-4bcd-90ab-921eaa66c5fa None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:17.027293 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ecb16-e57f-4bcd-90ab-921eaa66c5fa None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:17.027930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ecb16-e57f-4bcd-90ab-921eaa66c5fa None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:17.030443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 19/38] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:17.032507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f1d97-788c-4c05-80a5-edfbfd30d27f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:17.032874 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f1d97-788c-4c05-80a5-edfbfd30d27f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:17.033336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f1d97-788c-4c05-80a5-edfbfd30d27f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:17.035561 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 20/39] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:17.036689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f1d97-788c-4c05-80a5-edfbfd30d27f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:17.130572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4aac-8f86-4b62-8f73-944d98cc994c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:17.141857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:17.189421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62b347-b7f4-4c4c-9b5d-929fb73120b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:17.190372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b347-b7f4-4c4c-9b5d-929fb73120b1 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:17.190825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b347-b7f4-4c4c-9b5d-929fb73120b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:17.191261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b347-b7f4-4c4c-9b5d-929fb73120b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:17.192499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62b347-b7f4-4c4c-9b5d-929fb73120b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:17.194836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62b347-b7f4-4c4c-9b5d-929fb73120b1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:17.217017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f1d97-788c-4c05-80a5-edfbfd30d27f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:17.263912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76ea25-96e9-4152-b1ed-6b7a53acfcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:17.264802 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76ea25-96e9-4152-b1ed-6b7a53acfcff None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:17.265085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76ea25-96e9-4152-b1ed-6b7a53acfcff None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:17.265396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76ea25-96e9-4152-b1ed-6b7a53acfcff None admin] PATH_INFO: `/v3/domains/default/users/a2fa31ddd5e14c2dba5028b21c5db486/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:17.267780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76ea25-96e9-4152-b1ed-6b7a53acfcff None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a2fa31ddd5e14c2dba5028b21c5db486, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:17.269310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76ea25-96e9-4152-b1ed-6b7a53acfcff None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:17.289435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 21/40] 10.222.0.45 () {58 vars in 1361 bytes} [Fri Jun 17 14:58:17 2022] PUT /identity/v3/domains/default/users/a2fa31ddd5e14c2dba5028b21c5db486/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:58:17.290831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7df1-7f48-4366-9880-15d9e9ed1a9e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:17.291127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7df1-7f48-4366-9880-15d9e9ed1a9e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:17.291582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7df1-7f48-4366-9880-15d9e9ed1a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:17.316585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f0bb7df1-7f48-4366-9880-15d9e9ed1a9e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:17.318318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f0bb7df1-7f48-4366-9880-15d9e9ed1a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:17.408008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 22/41] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:17.410930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdbf8a-a77b-412b-9be2-563b93faed09 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:17.411834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdbf8a-a77b-412b-9be2-563b93faed09 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:17.412609 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdbf8a-a77b-412b-9be2-563b93faed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:17.447241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b0bdbf8a-a77b-412b-9be2-563b93faed09 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:17.449068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b0bdbf8a-a77b-412b-9be2-563b93faed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:17.520953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 20/42] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 14:58:16 2022] POST /identity/v3/projects => generated 301 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:17.522548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62b347-b7f4-4c4c-9b5d-929fb73120b1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:17.537626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:17.559084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 23/43] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:17.599910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdbf8a-a77b-412b-9be2-563b93faed09 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:17.632008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:17.671532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62b347-b7f4-4c4c-9b5d-929fb73120b1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:17.722029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984e6a2-fa94-4be2-81a4-e8d8ddbc2df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:17.722939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984e6a2-fa94-4be2-81a4-e8d8ddbc2df9 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:17.723228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984e6a2-fa94-4be2-81a4-e8d8ddbc2df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:17.723510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984e6a2-fa94-4be2-81a4-e8d8ddbc2df9 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:17.724383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984e6a2-fa94-4be2-81a4-e8d8ddbc2df9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:17.726251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984e6a2-fa94-4be2-81a4-e8d8ddbc2df9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:17.749014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 21/44] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Jun 17 14:58:17 2022] POST /identity/v3/roles => generated 223 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:17.818463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdbf8a-a77b-412b-9be2-563b93faed09 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:17.867206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31259ac-a7ea-4b21-a617-25217d1bce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:17.868045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31259ac-a7ea-4b21-a617-25217d1bce13 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:17.868324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31259ac-a7ea-4b21-a617-25217d1bce13 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:17.868593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31259ac-a7ea-4b21-a617-25217d1bce13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:17.870109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31259ac-a7ea-4b21-a617-25217d1bce13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:17.872246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31259ac-a7ea-4b21-a617-25217d1bce13 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:17.874643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 24/45] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:17.880501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984e6a2-fa94-4be2-81a4-e8d8ddbc2df9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:18.049915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984e6a2-fa94-4be2-81a4-e8d8ddbc2df9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:18.080822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:18.104798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27237-6f55-4398-9506-89d1bfbc1ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:18.106070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27237-6f55-4398-9506-89d1bfbc1ffd None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:18.106576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27237-6f55-4398-9506-89d1bfbc1ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:18.107064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27237-6f55-4398-9506-89d1bfbc1ffd None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:18.108391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c27237-6f55-4398-9506-89d1bfbc1ffd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:18.111141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c27237-6f55-4398-9506-89d1bfbc1ffd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:18.150245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 22/46] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 14:58:17 2022] POST /identity/v3/projects => generated 312 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:19.612912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8db06-b682-4810-8052-72c66dc9d31f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:19.613482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8db06-b682-4810-8052-72c66dc9d31f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:19.613482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8db06-b682-4810-8052-72c66dc9d31f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:19.615052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 25/47] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:19.620278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604bd4-f4ad-4314-a5a1-8d7387c5504c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:19.620747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604bd4-f4ad-4314-a5a1-8d7387c5504c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:19.620823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604bd4-f4ad-4314-a5a1-8d7387c5504c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:19.638988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c9604bd4-f4ad-4314-a5a1-8d7387c5504c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:19.640528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c9604bd4-f4ad-4314-a5a1-8d7387c5504c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:19.711898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 23/48] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:19.735266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8db06-b682-4810-8052-72c66dc9d31f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:19.794937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:19.848533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8db06-b682-4810-8052-72c66dc9d31f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:19.884231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f033e2c-22ab-4b21-b016-4338f1f63d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:19.884949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033e2c-22ab-4b21-b016-4338f1f63d46 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:19.885237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033e2c-22ab-4b21-b016-4338f1f63d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:19.885538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033e2c-22ab-4b21-b016-4338f1f63d46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:19.896863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f033e2c-22ab-4b21-b016-4338f1f63d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-2f033e2c-22ab-4b21-b016-4338f1f63d46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:19.905151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:19.906058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:19.906795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 26/49] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:58:19.912485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604bd4-f4ad-4314-a5a1-8d7387c5504c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:20.018548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604bd4-f4ad-4314-a5a1-8d7387c5504c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:20.020134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:20.056230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7fce5-73ab-4aec-aebc-b222f214b106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:20.056913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7fce5-73ab-4aec-aebc-b222f214b106 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:20.057199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7fce5-73ab-4aec-aebc-b222f214b106 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:20.057515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7fce5-73ab-4aec-aebc-b222f214b106 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:20.058273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7fce5-73ab-4aec-aebc-b222f214b106 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:20.058589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7fce5-73ab-4aec-aebc-b222f214b106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:20.060991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7fce5-73ab-4aec-aebc-b222f214b106 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:20.069567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 24/50] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:20.075931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f033e2c-22ab-4b21-b016-4338f1f63d46 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:20.183272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f033e2c-22ab-4b21-b016-4338f1f63d46 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:20.194303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:20.220098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aa449-3227-4aae-97fc-7d201d9ede06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:20.220967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aa449-3227-4aae-97fc-7d201d9ede06 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:20.221239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aa449-3227-4aae-97fc-7d201d9ede06 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:20.221550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aa449-3227-4aae-97fc-7d201d9ede06 None admin] PATH_INFO: `/v3/users/a2fa31ddd5e14c2dba5028b21c5db486` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:20.222864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4aa449-3227-4aae-97fc-7d201d9ede06 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fa31ddd5e14c2dba5028b21c5db486)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:20.224309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4aa449-3227-4aae-97fc-7d201d9ede06 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:20.225955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 27/51] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:20 2022] GET /identity/v3/users/a2fa31ddd5e14c2dba5028b21c5db486 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:20.231622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7fce5-73ab-4aec-aebc-b222f214b106 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:20.338051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7fce5-73ab-4aec-aebc-b222f214b106 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:20.373451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456336e-3a42-4cb8-a4c9-79f511964df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:20.374304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456336e-3a42-4cb8-a4c9-79f511964df2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:20.374587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456336e-3a42-4cb8-a4c9-79f511964df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:20.374864 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456336e-3a42-4cb8-a4c9-79f511964df2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:20.376341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456336e-3a42-4cb8-a4c9-79f511964df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:20.377916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456336e-3a42-4cb8-a4c9-79f511964df2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:20.379595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 25/52] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:20.386035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aa449-3227-4aae-97fc-7d201d9ede06 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:20.496174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aa449-3227-4aae-97fc-7d201d9ede06 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:20.533796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2bde-f6ae-4d54-a242-c5c4d63653a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:20.534771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2bde-f6ae-4d54-a242-c5c4d63653a6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:20.535053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2bde-f6ae-4d54-a242-c5c4d63653a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:20.535326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2bde-f6ae-4d54-a242-c5c4d63653a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:20.536181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2bde-f6ae-4d54-a242-c5c4d63653a6 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.domain.id=default, user.id=a2fa31ddd5e14c2dba5028b21c5db486) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:20.536492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2bde-f6ae-4d54-a242-c5c4d63653a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:20.537991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2bde-f6ae-4d54-a242-c5c4d63653a6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:20.546757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 28/53] 10.222.0.45 () {56 vars in 1322 bytes} [Fri Jun 17 14:58:20 2022] GET /identity/v3/role_assignments?user.id=a2fa31ddd5e14c2dba5028b21c5db486&scope.domain.id=default&role.id=8a6fe5045159487aa0119348cfe94387 => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:20.686115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e0b2-cd9b-4d71-8e39-cf3d1c076458 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:20.686963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e0b2-cd9b-4d71-8e39-cf3d1c076458 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:20.687219 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e0b2-cd9b-4d71-8e39-cf3d1c076458 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:20.688789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 26/54] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:20.694858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b760-6c9b-40ef-9acb-3288fddf66b0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:20.695401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b760-6c9b-40ef-9acb-3288fddf66b0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:20.695401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b760-6c9b-40ef-9acb-3288fddf66b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:20.715612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0797b760-6c9b-40ef-9acb-3288fddf66b0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:20.717074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0797b760-6c9b-40ef-9acb-3288fddf66b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:20.760266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:20.801979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 29/55] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:20.827198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e0b2-cd9b-4d71-8e39-cf3d1c076458 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:20.860966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:20.940580 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e0b2-cd9b-4d71-8e39-cf3d1c076458 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:20.976261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba54946-177f-4b86-981e-41c5641eaff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:20.977057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba54946-177f-4b86-981e-41c5641eaff1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:20.977374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba54946-177f-4b86-981e-41c5641eaff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:20.977657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba54946-177f-4b86-981e-41c5641eaff1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:20.978910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba54946-177f-4b86-981e-41c5641eaff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:20.980401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba54946-177f-4b86-981e-41c5641eaff1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:20.982108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 27/56] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:20.987936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b760-6c9b-40ef-9acb-3288fddf66b0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:21.099672 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b760-6c9b-40ef-9acb-3288fddf66b0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:21.138480 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3705991-2d97-470e-b984-1966285a2a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:21.139200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3705991-2d97-470e-b984-1966285a2a54 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:21.139489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3705991-2d97-470e-b984-1966285a2a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:21.139766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3705991-2d97-470e-b984-1966285a2a54 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:21.140521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3705991-2d97-470e-b984-1966285a2a54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:21.142080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3705991-2d97-470e-b984-1966285a2a54 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:21.171896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 30/57] 10.222.0.45 () {60 vars in 1140 bytes} [Fri Jun 17 14:58:20 2022] POST /identity/v3/projects => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:23.360983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300993e3-8dd3-4310-9494-2cdb4cddeb18 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:23.361613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300993e3-8dd3-4310-9494-2cdb4cddeb18 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:23.361613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300993e3-8dd3-4310-9494-2cdb4cddeb18 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:23.362966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 28/58] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:23.368878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef41199-da5f-4022-902f-0fba90ede88a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:23.369333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef41199-da5f-4022-902f-0fba90ede88a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:23.369418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef41199-da5f-4022-902f-0fba90ede88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:23.389269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7ef41199-da5f-4022-902f-0fba90ede88a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:23.390482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7ef41199-da5f-4022-902f-0fba90ede88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:23.409882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:23.468739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 31/59] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:23.493402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300993e3-8dd3-4310-9494-2cdb4cddeb18 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:23.599223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:23.603943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300993e3-8dd3-4310-9494-2cdb4cddeb18 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:23.643757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60452072-ddf5-43ce-b705-8499b5b87e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:23.644528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60452072-ddf5-43ce-b705-8499b5b87e95 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:23.644808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60452072-ddf5-43ce-b705-8499b5b87e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:23.645086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60452072-ddf5-43ce-b705-8499b5b87e95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:23.646473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60452072-ddf5-43ce-b705-8499b5b87e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:23.647995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60452072-ddf5-43ce-b705-8499b5b87e95 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:23.649699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 29/60] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:23.655841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef41199-da5f-4022-902f-0fba90ede88a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:23.757483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef41199-da5f-4022-902f-0fba90ede88a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:23.803813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e47c78-6106-48cd-af40-fb2986c1c8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:23.804498 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47c78-6106-48cd-af40-fb2986c1c8d2 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:23.804778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47c78-6106-48cd-af40-fb2986c1c8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:23.805052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47c78-6106-48cd-af40-fb2986c1c8d2 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:23.805868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e47c78-6106-48cd-af40-fb2986c1c8d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:23.807341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e47c78-6106-48cd-af40-fb2986c1c8d2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:23.843334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 32/61] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:58:23 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:27.380519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9000-8115-4758-a906-b0297d7a652e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.381413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9000-8115-4758-a906-b0297d7a652e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.381840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9000-8115-4758-a906-b0297d7a652e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.383675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 30/62] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:27.402189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232bc1-23a7-403c-a40a-cbb3651723b0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.403090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232bc1-23a7-403c-a40a-cbb3651723b0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.403504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232bc1-23a7-403c-a40a-cbb3651723b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.427492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c5232bc1-23a7-403c-a40a-cbb3651723b0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:27.428967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c5232bc1-23a7-403c-a40a-cbb3651723b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:27.434533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:27.507502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4c51-56b0-4106-bd89-d91ebd076ccc None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.507791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4c51-56b0-4106-bd89-d91ebd076ccc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.508309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4c51-56b0-4106-bd89-d91ebd076ccc None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.510040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:58:27.515953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ec59a-811c-48f4-919f-da2c9b79c5cc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.516525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ec59a-811c-48f4-919f-da2c9b79c5cc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.517000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ec59a-811c-48f4-919f-da2c9b79c5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.532243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 33/64] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:27.536343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-eb4ec59a-811c-48f4-919f-da2c9b79c5cc None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:27.538002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eb4ec59a-811c-48f4-919f-da2c9b79c5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:27.573919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232bc1-23a7-403c-a40a-cbb3651723b0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:27.658700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 32/65] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:27.671270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb07b-49a4-49e3-8987-113e24bba548 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.672158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb07b-49a4-49e3-8987-113e24bba548 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.672858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb07b-49a4-49e3-8987-113e24bba548 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.675935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 33/66] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:27 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:27.683855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1324-3d29-47aa-9e47-13913c09dd7b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.684730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1324-3d29-47aa-9e47-13913c09dd7b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.685533 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1324-3d29-47aa-9e47-13913c09dd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.721135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-105d1324-3d29-47aa-9e47-13913c09dd7b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:27.722670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-105d1324-3d29-47aa-9e47-13913c09dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:27.743706 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232bc1-23a7-403c-a40a-cbb3651723b0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:27.788311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bb0ba-5553-4546-8ed3-7977c98bf33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:27.789139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bb0ba-5553-4546-8ed3-7977c98bf33f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.789601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bb0ba-5553-4546-8ed3-7977c98bf33f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.790027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bb0ba-5553-4546-8ed3-7977c98bf33f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.798941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:27.802584 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bb0ba-5553-4546-8ed3-7977c98bf33f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:27.813234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 34/67] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:27.813234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d1324-3d29-47aa-9e47-13913c09dd7b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1f2bb0ba-5553-4546-8ed3-7977c98bf33f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:27.813470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:27.814270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:27.815017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 34/68] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:58:27.815631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aa021-8699-48ea-aa29-96e35c937779 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.815890 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aa021-8699-48ea-aa29-96e35c937779 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.816668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aa021-8699-48ea-aa29-96e35c937779 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.822779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 35/69] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:27.823771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aa021-8699-48ea-aa29-96e35c937779 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:27.839434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:27.919558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d1324-3d29-47aa-9e47-13913c09dd7b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:27.944358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aa021-8699-48ea-aa29-96e35c937779 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:27.959674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a416c0-e2ad-4841-baf4-fe3fb5200bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:27.960506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a416c0-e2ad-4841-baf4-fe3fb5200bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.960791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a416c0-e2ad-4841-baf4-fe3fb5200bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.961072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a416c0-e2ad-4841-baf4-fe3fb5200bf6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.973150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a416c0-e2ad-4841-baf4-fe3fb5200bf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f7a416c0-e2ad-4841-baf4-fe3fb5200bf6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:27.981599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:27.982465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:27.983232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 35/70] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:58:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:27.984477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c833-4d57-4a4f-9873-d4d9fc5ac2f9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.984477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c833-4d57-4a4f-9873-d4d9fc5ac2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.984698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c833-4d57-4a4f-9873-d4d9fc5ac2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.990011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ad653-5bfb-49ea-8856-2ba0d69ca565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:27.990704 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ad653-5bfb-49ea-8856-2ba0d69ca565 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:27.990981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ad653-5bfb-49ea-8856-2ba0d69ca565 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:27.991416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ad653-5bfb-49ea-8856-2ba0d69ca565 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:27.992517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ad653-5bfb-49ea-8856-2ba0d69ca565 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:27.992829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ad653-5bfb-49ea-8856-2ba0d69ca565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:27.994274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ad653-5bfb-49ea-8856-2ba0d69ca565 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:28.005902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 36/71] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:28.006072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2978c833-4d57-4a4f-9873-d4d9fc5ac2f9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:28.007117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2978c833-4d57-4a4f-9873-d4d9fc5ac2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:28.008096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ad653-5bfb-49ea-8856-2ba0d69ca565 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:28.103133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:28.106757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 36/72] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:28.107772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c833-4d57-4a4f-9873-d4d9fc5ac2f9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:28.131674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:28.156796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ad653-5bfb-49ea-8856-2ba0d69ca565 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:28.195493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa3edb-99fc-410d-9027-83b1265b4f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:28.196213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3edb-99fc-410d-9027-83b1265b4f33 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.196500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3edb-99fc-410d-9027-83b1265b4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.196783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3edb-99fc-410d-9027-83b1265b4f33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.207824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa3edb-99fc-410d-9027-83b1265b4f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9efa3edb-99fc-410d-9027-83b1265b4f33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:28.215542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:28.216425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:28.222537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa3edb-99fc-410d-9027-83b1265b4f33 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:28.223277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c833-4d57-4a4f-9873-d4d9fc5ac2f9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:28.255434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fec511-220a-4115-aca3-e80b1c87c73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:28.256086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fec511-220a-4115-aca3-e80b1c87c73d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.256366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fec511-220a-4115-aca3-e80b1c87c73d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.256650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fec511-220a-4115-aca3-e80b1c87c73d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.257430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fec511-220a-4115-aca3-e80b1c87c73d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:28.257738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fec511-220a-4115-aca3-e80b1c87c73d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:28.259142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fec511-220a-4115-aca3-e80b1c87c73d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:28.267565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 37/74] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:28.268858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945e4c-7799-4610-9eb8-4efe69b51ed9 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.269147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945e4c-7799-4610-9eb8-4efe69b51ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.269459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945e4c-7799-4610-9eb8-4efe69b51ed9 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.270704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 38/75] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:28.271644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49945e4c-7799-4610-9eb8-4efe69b51ed9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:28.325871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa3edb-99fc-410d-9027-83b1265b4f33 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:28.350492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:28.355100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:28.364286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600b025-30d6-4fcc-96da-43e74d9d5eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:28.365320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600b025-30d6-4fcc-96da-43e74d9d5eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.365606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600b025-30d6-4fcc-96da-43e74d9d5eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.365884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600b025-30d6-4fcc-96da-43e74d9d5eb8 None admin] PATH_INFO: `/v3/users/9d87e4186e5d4797a064a0e3092c629d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.376045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49945e4c-7799-4610-9eb8-4efe69b51ed9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:28.383569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600b025-30d6-4fcc-96da-43e74d9d5eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=9d87e4186e5d4797a064a0e3092c629d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:28.385513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600b025-30d6-4fcc-96da-43e74d9d5eb8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:28.392315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 38/76] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/users/9d87e4186e5d4797a064a0e3092c629d => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:28.392315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600b025-30d6-4fcc-96da-43e74d9d5eb8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:28.415842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16776-bdaf-4c0b-9fe4-cb2a86e31c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:28.416650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16776-bdaf-4c0b-9fe4-cb2a86e31c84 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.416939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16776-bdaf-4c0b-9fe4-cb2a86e31c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.417239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16776-bdaf-4c0b-9fe4-cb2a86e31c84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.428678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b16776-bdaf-4c0b-9fe4-cb2a86e31c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f2b16776-bdaf-4c0b-9fe4-cb2a86e31c84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:28.436752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:28.437764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:28.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 39/77] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:28.439159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16776-bdaf-4c0b-9fe4-cb2a86e31c84 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:28.494998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600b025-30d6-4fcc-96da-43e74d9d5eb8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:28.529119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ea5e9-16c4-4b45-8f0c-4fcaf3707b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:28.530113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ea5e9-16c4-4b45-8f0c-4fcaf3707b2a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.530402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ea5e9-16c4-4b45-8f0c-4fcaf3707b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.530683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ea5e9-16c4-4b45-8f0c-4fcaf3707b2a None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.531436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ea5e9-16c4-4b45-8f0c-4fcaf3707b2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:28.531747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ea5e9-16c4-4b45-8f0c-4fcaf3707b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:28.533147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ea5e9-16c4-4b45-8f0c-4fcaf3707b2a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:28.541350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 39/78] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:28.542605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70d8e-419d-4e38-bc0c-8dc34febff30 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.542926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70d8e-419d-4e38-bc0c-8dc34febff30 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.543235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70d8e-419d-4e38-bc0c-8dc34febff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.544684 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16776-bdaf-4c0b-9fe4-cb2a86e31c84 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:28.561387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-69a70d8e-419d-4e38-bc0c-8dc34febff30 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:28.562622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-69a70d8e-419d-4e38-bc0c-8dc34febff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:28.581001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1b2ae-628a-4a3d-bbb4-3a22f825398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:28.582012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b2ae-628a-4a3d-bbb4-3a22f825398f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.582295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b2ae-628a-4a3d-bbb4-3a22f825398f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.582568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b2ae-628a-4a3d-bbb4-3a22f825398f None admin] PATH_INFO: `/v3/users/9d87e4186e5d4797a064a0e3092c629d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.583872 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1b2ae-628a-4a3d-bbb4-3a22f825398f None admin] RBAC: Authorizing `identity:get_user(user_id=9d87e4186e5d4797a064a0e3092c629d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:28.585388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1b2ae-628a-4a3d-bbb4-3a22f825398f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:28.587058 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 40/79] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/users/9d87e4186e5d4797a064a0e3092c629d => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:28.587951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1b2ae-628a-4a3d-bbb4-3a22f825398f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:28.599665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:28.600114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:28.633925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 40/80] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:28.634812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a70d8e-419d-4e38-bc0c-8dc34febff30 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:28.704382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1b2ae-628a-4a3d-bbb4-3a22f825398f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:28.743712 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd3220-81c2-45b5-aedf-ebda052a6a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:28.744375 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd3220-81c2-45b5-aedf-ebda052a6a87 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.744664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd3220-81c2-45b5-aedf-ebda052a6a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.744946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd3220-81c2-45b5-aedf-ebda052a6a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.752203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a70d8e-419d-4e38-bc0c-8dc34febff30 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:28.794493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183ad89-e945-4bb8-9e94-5bd4cd51215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:28.795190 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ad89-e945-4bb8-9e94-5bd4cd51215a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.795475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ad89-e945-4bb8-9e94-5bd4cd51215a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.795761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ad89-e945-4bb8-9e94-5bd4cd51215a None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.796526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183ad89-e945-4bb8-9e94-5bd4cd51215a None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:28.796838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183ad89-e945-4bb8-9e94-5bd4cd51215a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:28.798303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183ad89-e945-4bb8-9e94-5bd4cd51215a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:28.809798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 41/81] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:28.810823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183ad89-e945-4bb8-9e94-5bd4cd51215a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:28.831568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd3220-81c2-45b5-aedf-ebda052a6a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:28.833077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd3220-81c2-45b5-aedf-ebda052a6a87 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:28.846612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:28.849343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:28.924288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183ad89-e945-4bb8-9e94-5bd4cd51215a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:28.955816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 41/82] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:28.956698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd3220-81c2-45b5-aedf-ebda052a6a87 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:28.964116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e51a23-ec60-49ee-a1e2-4771eb48e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:28.965030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51a23-ec60-49ee-a1e2-4771eb48e04c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:28.965345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51a23-ec60-49ee-a1e2-4771eb48e04c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:28.966057 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51a23-ec60-49ee-a1e2-4771eb48e04c None admin] PATH_INFO: `/v3/users/a2fa31ddd5e14c2dba5028b21c5db486` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:28.967303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e51a23-ec60-49ee-a1e2-4771eb48e04c None admin] RBAC: Authorizing `identity:get_user(user_id=a2fa31ddd5e14c2dba5028b21c5db486)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:28.968779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e51a23-ec60-49ee-a1e2-4771eb48e04c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:28.970423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 42/83] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/users/a2fa31ddd5e14c2dba5028b21c5db486 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:28.971223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e51a23-ec60-49ee-a1e2-4771eb48e04c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:29.093573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd3220-81c2-45b5-aedf-ebda052a6a87 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:29.104131 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:29.113569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e51a23-ec60-49ee-a1e2-4771eb48e04c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:29.115345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:29.133666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2867-d8e1-43c8-949b-23bf362f18bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:29.134323 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2867-d8e1-43c8-949b-23bf362f18bd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:29.134631 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2867-d8e1-43c8-949b-23bf362f18bd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:29.134906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2867-d8e1-43c8-949b-23bf362f18bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:29.152696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfa5cf-31a2-444a-ba09-27867b8e6196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:29.153526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfa5cf-31a2-444a-ba09-27867b8e6196 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:29.153820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfa5cf-31a2-444a-ba09-27867b8e6196 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:29.154119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfa5cf-31a2-444a-ba09-27867b8e6196 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:29.155315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfa5cf-31a2-444a-ba09-27867b8e6196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:29.156760 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfa5cf-31a2-444a-ba09-27867b8e6196 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:29.158406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 43/84] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:29.159211 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfa5cf-31a2-444a-ba09-27867b8e6196 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:29.223970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a2867-d8e1-43c8-949b-23bf362f18bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:29.225504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a2867-d8e1-43c8-949b-23bf362f18bd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:29.275508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfa5cf-31a2-444a-ba09-27867b8e6196 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:29.321457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01bd9d-e3d8-493e-9635-d3a3c9c1e7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:29.322798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01bd9d-e3d8-493e-9635-d3a3c9c1e7de None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:29.323258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01bd9d-e3d8-493e-9635-d3a3c9c1e7de None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:29.323720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01bd9d-e3d8-493e-9635-d3a3c9c1e7de None admin] PATH_INFO: `/v3/users/9d87e4186e5d4797a064a0e3092c629d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:29.325594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01bd9d-e3d8-493e-9635-d3a3c9c1e7de None admin] RBAC: Authorizing `identity:get_user(user_id=9d87e4186e5d4797a064a0e3092c629d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:29.327392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01bd9d-e3d8-493e-9635-d3a3c9c1e7de None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:29.329055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 44/85] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:29 2022] GET /identity/v3/users/9d87e4186e5d4797a064a0e3092c629d => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:29.329879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01bd9d-e3d8-493e-9635-d3a3c9c1e7de None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:29.359608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 42/86] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:29.360454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2867-d8e1-43c8-949b-23bf362f18bd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:29.370988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:29.377919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:29.456455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01bd9d-e3d8-493e-9635-d3a3c9c1e7de None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:29.487440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2867-d8e1-43c8-949b-23bf362f18bd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:29.497968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d55387-3671-4eb5-acfc-78c46fb9042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:29.498846 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d55387-3671-4eb5-acfc-78c46fb9042a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:29.499127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d55387-3671-4eb5-acfc-78c46fb9042a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:29.499411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d55387-3671-4eb5-acfc-78c46fb9042a None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:29.500595 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d55387-3671-4eb5-acfc-78c46fb9042a None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:29.502088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d55387-3671-4eb5-acfc-78c46fb9042a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:29.508636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 45/87] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:29 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:29.508636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d55387-3671-4eb5-acfc-78c46fb9042a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:29.527162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296fa14-997d-40a4-bb6b-9418c5c857b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:29.527854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296fa14-997d-40a4-bb6b-9418c5c857b6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:29.528147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296fa14-997d-40a4-bb6b-9418c5c857b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:29.528540 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296fa14-997d-40a4-bb6b-9418c5c857b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:29.595558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296fa14-997d-40a4-bb6b-9418c5c857b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:29.597024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296fa14-997d-40a4-bb6b-9418c5c857b6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:29.605806 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d55387-3671-4eb5-acfc-78c46fb9042a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:29.606933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:29.613988 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:29.643747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28887f-ee6c-4109-b5e4-24f23798bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:29.644454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28887f-ee6c-4109-b5e4-24f23798bd77 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:29.644736 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28887f-ee6c-4109-b5e4-24f23798bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:29.645007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28887f-ee6c-4109-b5e4-24f23798bd77 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:29.645762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28887f-ee6c-4109-b5e4-24f23798bd77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:29.647243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28887f-ee6c-4109-b5e4-24f23798bd77 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:29.668746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 46/88] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:58:29 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:29.669603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28887f-ee6c-4109-b5e4-24f23798bd77 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:29.720341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 43/89] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:29.720341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296fa14-997d-40a4-bb6b-9418c5c857b6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:29.812342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28887f-ee6c-4109-b5e4-24f23798bd77 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:29.858341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a347cd5-ae33-47db-b264-26aba3753279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:29.859084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a347cd5-ae33-47db-b264-26aba3753279 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:29.861251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a347cd5-ae33-47db-b264-26aba3753279 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:29.861251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a347cd5-ae33-47db-b264-26aba3753279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:29.867528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296fa14-997d-40a4-bb6b-9418c5c857b6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:29.879141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:29.898018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:29.914393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a21677-23d2-4319-828e-117bb86631ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:29.915464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21677-23d2-4319-828e-117bb86631ba None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:29.915753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21677-23d2-4319-828e-117bb86631ba None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:29.916174 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21677-23d2-4319-828e-117bb86631ba None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:29.917624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a21677-23d2-4319-828e-117bb86631ba None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:29.920450 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a21677-23d2-4319-828e-117bb86631ba None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:29.922319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 44/90] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:29 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:29.923095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a21677-23d2-4319-828e-117bb86631ba None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:29.953755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a347cd5-ae33-47db-b264-26aba3753279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:29.955463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a347cd5-ae33-47db-b264-26aba3753279 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:30.071244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a21677-23d2-4319-828e-117bb86631ba None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:30.085599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 47/91] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:30.086494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a347cd5-ae33-47db-b264-26aba3753279 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:30.125095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738a60-c8d1-4954-a38b-223513bb0047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:30.125724 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738a60-c8d1-4954-a38b-223513bb0047 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:30.126006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738a60-c8d1-4954-a38b-223513bb0047 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:30.126299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738a60-c8d1-4954-a38b-223513bb0047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:30.127130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738a60-c8d1-4954-a38b-223513bb0047 None admin] RBAC: Adding query filter params (role.id=2b2ea3ada01041ad941dd5b6721df5b2, scope.project.id=df2e2d29dd144c198fac526f80a50009, user.id=9d87e4186e5d4797a064a0e3092c629d) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:30.127446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738a60-c8d1-4954-a38b-223513bb0047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:30.128908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738a60-c8d1-4954-a38b-223513bb0047 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:30.135232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 45/92] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:29 2022] GET /identity/v3/role_assignments?user.id=9d87e4186e5d4797a064a0e3092c629d&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:30.136090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738a60-c8d1-4954-a38b-223513bb0047 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:30.170738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:30.219925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a347cd5-ae33-47db-b264-26aba3753279 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:30.255780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:30.258974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafc34-e907-472d-96f3-ea23e40211bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:30.260171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafc34-e907-472d-96f3-ea23e40211bc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:30.260652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafc34-e907-472d-96f3-ea23e40211bc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:30.261113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafc34-e907-472d-96f3-ea23e40211bc None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:30.262805 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bafc34-e907-472d-96f3-ea23e40211bc None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:30.264559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bafc34-e907-472d-96f3-ea23e40211bc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:30.266927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 48/93] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:30 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:30.268036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafc34-e907-472d-96f3-ea23e40211bc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:30.375387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738a60-c8d1-4954-a38b-223513bb0047 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:30.383889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafc34-e907-472d-96f3-ea23e40211bc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:30.416257 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:30.423357 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308b42a-a864-4fe6-9de8-914d155fa611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:30.424506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308b42a-a864-4fe6-9de8-914d155fa611 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:30.424952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308b42a-a864-4fe6-9de8-914d155fa611 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:30.425536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308b42a-a864-4fe6-9de8-914d155fa611 None admin] PATH_INFO: `/v3/projects/c952466e04544fe6986a90c22f180537` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:30.427108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308b42a-a864-4fe6-9de8-914d155fa611 None admin] RBAC: Authorizing `identity:get_project(project_id=c952466e04544fe6986a90c22f180537)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:30.429089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308b42a-a864-4fe6-9de8-914d155fa611 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:30.432114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 49/94] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:30 2022] GET /identity/v3/projects/c952466e04544fe6986a90c22f180537 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:30.433110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308b42a-a864-4fe6-9de8-914d155fa611 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:30.465950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107666ea-37cf-4974-bcbd-30301ae414b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:30.466638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107666ea-37cf-4974-bcbd-30301ae414b4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:30.466927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107666ea-37cf-4974-bcbd-30301ae414b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:30.467218 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107666ea-37cf-4974-bcbd-30301ae414b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:30.468049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107666ea-37cf-4974-bcbd-30301ae414b4 None admin] RBAC: Adding query filter params (role.id=f36f89c30b0a4c38900202ea156ed20e, scope.project.id=df2e2d29dd144c198fac526f80a50009, user.id=9d87e4186e5d4797a064a0e3092c629d) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:30.468365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107666ea-37cf-4974-bcbd-30301ae414b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:30.469877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107666ea-37cf-4974-bcbd-30301ae414b4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:30.487616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 46/95] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:30 2022] GET /identity/v3/role_assignments?user.id=9d87e4186e5d4797a064a0e3092c629d&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=f36f89c30b0a4c38900202ea156ed20e => generated 259 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:30.487616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107666ea-37cf-4974-bcbd-30301ae414b4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:30.719799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308b42a-a864-4fe6-9de8-914d155fa611 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:30.752933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107666ea-37cf-4974-bcbd-30301ae414b4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:30.762554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:30.794390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727df534-b926-479b-bedf-103a0b31bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:30.795065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727df534-b926-479b-bedf-103a0b31bd13 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:30.795349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727df534-b926-479b-bedf-103a0b31bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:30.795629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727df534-b926-479b-bedf-103a0b31bd13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:30.796477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727df534-b926-479b-bedf-103a0b31bd13 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=df2e2d29dd144c198fac526f80a50009, user.id=a2fa31ddd5e14c2dba5028b21c5db486) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:30.796792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727df534-b926-479b-bedf-103a0b31bd13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:30.798502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727df534-b926-479b-bedf-103a0b31bd13 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:30.805380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 50/96] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:30 2022] GET /identity/v3/role_assignments?user.id=a2fa31ddd5e14c2dba5028b21c5db486&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=8a6fe5045159487aa0119348cfe94387 => generated 259 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:30.823571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1c482-e1cd-498c-a60b-436d1617cb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:30.824818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1c482-e1cd-498c-a60b-436d1617cb2e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:30.825349 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1c482-e1cd-498c-a60b-436d1617cb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:30.825854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1c482-e1cd-498c-a60b-436d1617cb2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:30.827243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1c482-e1cd-498c-a60b-436d1617cb2e None admin] RBAC: Adding query filter params (role.id=2b2ea3ada01041ad941dd5b6721df5b2, scope.project.id=c952466e04544fe6986a90c22f180537, user.id=9d87e4186e5d4797a064a0e3092c629d) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:30.827774 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1c482-e1cd-498c-a60b-436d1617cb2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:30.829639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1c482-e1cd-498c-a60b-436d1617cb2e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:30.836560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 47/97] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:30 2022] GET /identity/v3/role_assignments?user.id=9d87e4186e5d4797a064a0e3092c629d&scope.project.id=c952466e04544fe6986a90c22f180537&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:32.482192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63ab1f-3d83-452f-91ee-713c742cdd84 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:32.482778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63ab1f-3d83-452f-91ee-713c742cdd84 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:32.483157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63ab1f-3d83-452f-91ee-713c742cdd84 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:32.485838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 51/98] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:32.491926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fc5d5-e0a0-4ac1-bf4a-309d1ac6c057 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:32.492444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fc5d5-e0a0-4ac1-bf4a-309d1ac6c057 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:32.492891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fc5d5-e0a0-4ac1-bf4a-309d1ac6c057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:32.517511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a161608-f2ec-420d-a704-97b540dbcde9 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:32.517898 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a161608-f2ec-420d-a704-97b540dbcde9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:32.518066 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a161608-f2ec-420d-a704-97b540dbcde9 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:32.519431 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 52/99] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:58:32.524542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a51f0-e87a-4985-9af0-dea768439bf9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:32.524825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a51f0-e87a-4985-9af0-dea768439bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:32.525107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a51f0-e87a-4985-9af0-dea768439bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:32.534831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3a7fc5d5-e0a0-4ac1-bf4a-309d1ac6c057 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:32.536876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3a7fc5d5-e0a0-4ac1-bf4a-309d1ac6c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:32.542208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8b1a51f0-e87a-4985-9af0-dea768439bf9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:32.543421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8b1a51f0-e87a-4985-9af0-dea768439bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:32.606260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:32.617884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 53/100] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:32.642047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a51f0-e87a-4985-9af0-dea768439bf9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:32.744269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a51f0-e87a-4985-9af0-dea768439bf9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:32.764279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 48/101] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:32.797943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db293a9a-a50b-4043-aae5-2ac4dffdf109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:32.798775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db293a9a-a50b-4043-aae5-2ac4dffdf109 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:32.799056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db293a9a-a50b-4043-aae5-2ac4dffdf109 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:32.799326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db293a9a-a50b-4043-aae5-2ac4dffdf109 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:32.815295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db293a9a-a50b-4043-aae5-2ac4dffdf109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-db293a9a-a50b-4043-aae5-2ac4dffdf109 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:32.822968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:32.823843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:32.824717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 54/102] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:58:32.831377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fc5d5-e0a0-4ac1-bf4a-309d1ac6c057 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:32.832879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db293a9a-a50b-4043-aae5-2ac4dffdf109 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:32.891598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:32.942967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db293a9a-a50b-4043-aae5-2ac4dffdf109 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:32.986179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3430ba1-2800-481a-acd3-d7c2e3e9ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:32.987007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430ba1-2800-481a-acd3-d7c2e3e9ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:32.987289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430ba1-2800-481a-acd3-d7c2e3e9ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:32.987564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430ba1-2800-481a-acd3-d7c2e3e9ffd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:32.988861 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3430ba1-2800-481a-acd3-d7c2e3e9ffd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:32.990354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3430ba1-2800-481a-acd3-d7c2e3e9ffd1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:32.991981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 55/103] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:32.997999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3430ba1-2800-481a-acd3-d7c2e3e9ffd1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:33.010502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fc5d5-e0a0-4ac1-bf4a-309d1ac6c057 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:33.013909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:33.048527 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63ec03-7460-4151-b5c8-96b8776de82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:33.049415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63ec03-7460-4151-b5c8-96b8776de82e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:33.049808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63ec03-7460-4151-b5c8-96b8776de82e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:33.050199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63ec03-7460-4151-b5c8-96b8776de82e None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:33.051141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63ec03-7460-4151-b5c8-96b8776de82e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:33.051551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63ec03-7460-4151-b5c8-96b8776de82e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:33.053158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63ec03-7460-4151-b5c8-96b8776de82e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:33.063248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 49/104] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:33.081111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63ec03-7460-4151-b5c8-96b8776de82e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:33.131980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3430ba1-2800-481a-acd3-d7c2e3e9ffd1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:33.182381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:33.218586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63ec03-7460-4151-b5c8-96b8776de82e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:33.244584 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc01789-0cfe-49b6-8a92-8c40172e4d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:33.246158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc01789-0cfe-49b6-8a92-8c40172e4d9a None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:33.247175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc01789-0cfe-49b6-8a92-8c40172e4d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:33.247943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc01789-0cfe-49b6-8a92-8c40172e4d9a None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:33.249682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc01789-0cfe-49b6-8a92-8c40172e4d9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:33.252429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc01789-0cfe-49b6-8a92-8c40172e4d9a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:33.261236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2e094-b8d7-46fc-b0b3-4b01756aa7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:33.261236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e094-b8d7-46fc-b0b3-4b01756aa7de None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:33.261236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e094-b8d7-46fc-b0b3-4b01756aa7de None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:33.261236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e094-b8d7-46fc-b0b3-4b01756aa7de None admin] PATH_INFO: `/v3/users/ec10c91ec43245368f014e6cdc7edf05` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:33.271479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2e094-b8d7-46fc-b0b3-4b01756aa7de None admin] RBAC: Authorizing `identity:get_user(user_id=ec10c91ec43245368f014e6cdc7edf05)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:33.272975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2e094-b8d7-46fc-b0b3-4b01756aa7de None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:33.274873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 50/105] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:33 2022] GET /identity/v3/users/ec10c91ec43245368f014e6cdc7edf05 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:33.284508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2e094-b8d7-46fc-b0b3-4b01756aa7de None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:33.301266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:33.333065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 56/106] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 14:58:32 2022] POST /identity/v3/projects => generated 302 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 14:58:33.399188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2e094-b8d7-46fc-b0b3-4b01756aa7de None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:33.438747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac8f8b-8d46-4274-9017-305d610ab9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:33.439441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac8f8b-8d46-4274-9017-305d610ab9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:33.439727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac8f8b-8d46-4274-9017-305d610ab9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:33.440013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac8f8b-8d46-4274-9017-305d610ab9a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:33.518326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac8f8b-8d46-4274-9017-305d610ab9a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:33.519731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac8f8b-8d46-4274-9017-305d610ab9a3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:33.540652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:33.657641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 51/107] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:33.660091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc01789-0cfe-49b6-8a92-8c40172e4d9a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:33.856838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc01789-0cfe-49b6-8a92-8c40172e4d9a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:33.887584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf767-e257-4ab4-b5ed-8c3a6c3dac4a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:33.887891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf767-e257-4ab4-b5ed-8c3a6c3dac4a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:33.888159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf767-e257-4ab4-b5ed-8c3a6c3dac4a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:33.891444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 52/108] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:33.897975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93686dd-5abd-4667-b386-b7621a9af48c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:33.898421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93686dd-5abd-4667-b386-b7621a9af48c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:33.898821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93686dd-5abd-4667-b386-b7621a9af48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:33.911943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c39e6-3065-4956-83c6-3f773308eb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:33.912888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c39e6-3065-4956-83c6-3f773308eb0e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:33.913960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c39e6-3065-4956-83c6-3f773308eb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:33.914246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c39e6-3065-4956-83c6-3f773308eb0e None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:33.915689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c39e6-3065-4956-83c6-3f773308eb0e None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:33.917172 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c39e6-3065-4956-83c6-3f773308eb0e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:33.919363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 57/109] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:33 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:33.936305 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b93686dd-5abd-4667-b386-b7621a9af48c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:33.938164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c39e6-3065-4956-83c6-3f773308eb0e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:33.938388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b93686dd-5abd-4667-b386-b7621a9af48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:34.008081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:34.021252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 53/110] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:34.046451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93686dd-5abd-4667-b386-b7621a9af48c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:34.087255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c39e6-3065-4956-83c6-3f773308eb0e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:34.119414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:34.147174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300eb88-9627-4ad5-bacd-c61ded9baef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:34.148255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300eb88-9627-4ad5-bacd-c61ded9baef6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.148767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300eb88-9627-4ad5-bacd-c61ded9baef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.149267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300eb88-9627-4ad5-bacd-c61ded9baef6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.150314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300eb88-9627-4ad5-bacd-c61ded9baef6 None admin] RBAC: Adding query filter params (role.id=16a382e27714463d91383877be17fa0a, scope.project.id=df2e2d29dd144c198fac526f80a50009, user.id=ec10c91ec43245368f014e6cdc7edf05) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:34.150846 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300eb88-9627-4ad5-bacd-c61ded9baef6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:34.153490 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300eb88-9627-4ad5-bacd-c61ded9baef6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:34.160384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 58/111] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:33 2022] GET /identity/v3/role_assignments?user.id=ec10c91ec43245368f014e6cdc7edf05&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=16a382e27714463d91383877be17fa0a => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:34.223888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93686dd-5abd-4667-b386-b7621a9af48c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:34.264738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22db14-66bf-489c-8a07-8d5cd4c74494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:34.265592 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22db14-66bf-489c-8a07-8d5cd4c74494 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.265877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22db14-66bf-489c-8a07-8d5cd4c74494 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.266159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22db14-66bf-489c-8a07-8d5cd4c74494 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.282884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22db14-66bf-489c-8a07-8d5cd4c74494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7d22db14-66bf-489c-8a07-8d5cd4c74494 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:34.290819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:34.291719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:34.292460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 54/112] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:34.300508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300eb88-9627-4ad5-bacd-c61ded9baef6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:34.419290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32101d4e-dc85-494f-8e38-8e6a8147dd1e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.419615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32101d4e-dc85-494f-8e38-8e6a8147dd1e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.419857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32101d4e-dc85-494f-8e38-8e6a8147dd1e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.421279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 55/113] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:34.430605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ea54f-7573-4a8c-98ba-76c93835c2ef None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.430896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ea54f-7573-4a8c-98ba-76c93835c2ef None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.431178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ea54f-7573-4a8c-98ba-76c93835c2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.434768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300eb88-9627-4ad5-bacd-c61ded9baef6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:34.443465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:34.470308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5f1ea54f-7573-4a8c-98ba-76c93835c2ef None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:34.471512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5f1ea54f-7573-4a8c-98ba-76c93835c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:34.475148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332575a-706c-4186-ae36-74ecc12e66ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:34.475842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332575a-706c-4186-ae36-74ecc12e66ea None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.476129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332575a-706c-4186-ae36-74ecc12e66ea None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.476427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332575a-706c-4186-ae36-74ecc12e66ea None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.477175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332575a-706c-4186-ae36-74ecc12e66ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:34.477550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332575a-706c-4186-ae36-74ecc12e66ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:34.478957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332575a-706c-4186-ae36-74ecc12e66ea None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:34.489250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 59/114] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:34.494665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332575a-706c-4186-ae36-74ecc12e66ea None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:34.663070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332575a-706c-4186-ae36-74ecc12e66ea None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:34.675127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 56/115] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:34.722319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dbe62-d4b9-428b-aa16-6db84f3e566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:34.723240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dbe62-d4b9-428b-aa16-6db84f3e566a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.723525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dbe62-d4b9-428b-aa16-6db84f3e566a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.723807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dbe62-d4b9-428b-aa16-6db84f3e566a None admin] PATH_INFO: `/v3/users/9d87e4186e5d4797a064a0e3092c629d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.725185 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dbe62-d4b9-428b-aa16-6db84f3e566a None admin] RBAC: Authorizing `identity:get_user(user_id=9d87e4186e5d4797a064a0e3092c629d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:34.726789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ea54f-7573-4a8c-98ba-76c93835c2ef None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:34.726919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dbe62-d4b9-428b-aa16-6db84f3e566a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:34.729116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 60/116] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:34 2022] GET /identity/v3/users/9d87e4186e5d4797a064a0e3092c629d => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:34.736131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dbe62-d4b9-428b-aa16-6db84f3e566a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:34.804161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:34.818855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:34.887716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dbe62-d4b9-428b-aa16-6db84f3e566a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:34.892406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ea54f-7573-4a8c-98ba-76c93835c2ef None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:34.925339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f6350-561e-4492-a14f-8815cb7d25a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:34.926187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f6350-561e-4492-a14f-8815cb7d25a9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.926435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f6350-561e-4492-a14f-8815cb7d25a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.926715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f6350-561e-4492-a14f-8815cb7d25a9 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.928015 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f6350-561e-4492-a14f-8815cb7d25a9 None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:34.929634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f6350-561e-4492-a14f-8815cb7d25a9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:34.931508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 61/117] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:34 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:34.932511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca8327-18f2-46eb-b212-083400d8bcc8 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.932796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca8327-18f2-46eb-b212-083400d8bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.933098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca8327-18f2-46eb-b212-083400d8bcc8 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.934938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f05ed7-c69c-4dfe-98d3-ed1c27cd1175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:34.935063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 62/118] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:34.939276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51304e-2e2d-46ea-8fea-ca8ad3991ba9 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.939276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51304e-2e2d-46ea-8fea-ca8ad3991ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.939276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51304e-2e2d-46ea-8fea-ca8ad3991ba9 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.939276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 63/119] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:34.940730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05ed7-c69c-4dfe-98d3-ed1c27cd1175 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.941068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51304e-2e2d-46ea-8fea-ca8ad3991ba9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:34.941347 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05ed7-c69c-4dfe-98d3-ed1c27cd1175 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.941775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05ed7-c69c-4dfe-98d3-ed1c27cd1175 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.960286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f05ed7-c69c-4dfe-98d3-ed1c27cd1175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-86f05ed7-c69c-4dfe-98d3-ed1c27cd1175 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:34.968748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:34.969797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:34.970730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:34.977752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 57/120] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:34.977752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cd1e5-1551-4cd4-a6a6-dc24631b7661 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:34.977752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cd1e5-1551-4cd4-a6a6-dc24631b7661 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:34.977752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cd1e5-1551-4cd4-a6a6-dc24631b7661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:34.999663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5b4cd1e5-1551-4cd4-a6a6-dc24631b7661 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:35.001015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5b4cd1e5-1551-4cd4-a6a6-dc24631b7661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:35.075343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51304e-2e2d-46ea-8fea-ca8ad3991ba9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:35.077612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:35.092340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 58/121] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:35.101657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e177c-252b-495f-b36b-c3aebb898541 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:35.101657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e177c-252b-495f-b36b-c3aebb898541 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:35.101657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e177c-252b-495f-b36b-c3aebb898541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:35.143414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-371e177c-252b-495f-b36b-c3aebb898541 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:35.144643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf5f84-2ddb-4482-a693-893c68fd71a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:35.145762 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-371e177c-252b-495f-b36b-c3aebb898541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:35.146143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5f84-2ddb-4482-a693-893c68fd71a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:35.146604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5f84-2ddb-4482-a693-893c68fd71a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:35.147058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5f84-2ddb-4482-a693-893c68fd71a5 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009/users/9d87e4186e5d4797a064a0e3092c629d/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:35.149615 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf5f84-2ddb-4482-a693-893c68fd71a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=df2e2d29dd144c198fac526f80a50009, user_id=9d87e4186e5d4797a064a0e3092c629d, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:35.151198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf5f84-2ddb-4482-a693-893c68fd71a5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:35.166302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 64/122] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:58:34 2022] PUT /identity/v3/projects/df2e2d29dd144c198fac526f80a50009/users/9d87e4186e5d4797a064a0e3092c629d/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 14:58:35.167477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf5f84-2ddb-4482-a693-893c68fd71a5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:35.179930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:35.233615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 59/123] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:35.234499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e177c-252b-495f-b36b-c3aebb898541 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:35.292259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf5f84-2ddb-4482-a693-893c68fd71a5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:35.348676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eca10-0e49-4d5f-bc45-d522c654fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:35.349894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eca10-0e49-4d5f-bc45-d522c654fff3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:35.350477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eca10-0e49-4d5f-bc45-d522c654fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:35.350951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eca10-0e49-4d5f-bc45-d522c654fff3 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:35.351907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eca10-0e49-4d5f-bc45-d522c654fff3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:35.352420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eca10-0e49-4d5f-bc45-d522c654fff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:35.354061 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eca10-0e49-4d5f-bc45-d522c654fff3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:35.365618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 65/124] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:35.367040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eca10-0e49-4d5f-bc45-d522c654fff3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:35.421691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:35.439621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e177c-252b-495f-b36b-c3aebb898541 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:35.484292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2e95c-c510-482f-9f0b-bc0aee42561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:35.485083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2e95c-c510-482f-9f0b-bc0aee42561a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:35.485408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2e95c-c510-482f-9f0b-bc0aee42561a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:35.485706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2e95c-c510-482f-9f0b-bc0aee42561a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:35.498680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2e95c-c510-482f-9f0b-bc0aee42561a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c1b2e95c-c510-482f-9f0b-bc0aee42561a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:35.507428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:35.508302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:35.509048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 60/125] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:58:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:35.509695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2e95c-c510-482f-9f0b-bc0aee42561a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:35.525549 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eca10-0e49-4d5f-bc45-d522c654fff3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:35.532690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:35.573879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137b494-ec76-41da-8366-06b8a3216245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:35.574855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137b494-ec76-41da-8366-06b8a3216245 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:35.575140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137b494-ec76-41da-8366-06b8a3216245 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:35.575531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137b494-ec76-41da-8366-06b8a3216245 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:35.600153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137b494-ec76-41da-8366-06b8a3216245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8137b494-ec76-41da-8366-06b8a3216245 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:35.608910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:35.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:35.611814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:35.618827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 66/126] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:35.620071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137b494-ec76-41da-8366-06b8a3216245 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:35.653598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2e95c-c510-482f-9f0b-bc0aee42561a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:35.697155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497ef5-9076-48a0-9175-5024803444ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:35.698868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497ef5-9076-48a0-9175-5024803444ab None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:35.700446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497ef5-9076-48a0-9175-5024803444ab None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:35.700940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497ef5-9076-48a0-9175-5024803444ab None admin] PATH_INFO: `/v3/users/9d87e4186e5d4797a064a0e3092c629d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:35.705302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52497ef5-9076-48a0-9175-5024803444ab None admin] RBAC: Authorizing `identity:get_user(user_id=9d87e4186e5d4797a064a0e3092c629d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:35.709075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52497ef5-9076-48a0-9175-5024803444ab None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:35.712251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 61/127] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:35 2022] GET /identity/v3/users/9d87e4186e5d4797a064a0e3092c629d => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:35.714158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497ef5-9076-48a0-9175-5024803444ab None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:35.831392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:35.863127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137b494-ec76-41da-8366-06b8a3216245 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:35.905634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:35.936467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6ed6b-131d-4938-baf0-881e1218d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:35.936764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497ef5-9076-48a0-9175-5024803444ab None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:35.937528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6ed6b-131d-4938-baf0-881e1218d604 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:35.937817 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6ed6b-131d-4938-baf0-881e1218d604 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:35.938621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6ed6b-131d-4938-baf0-881e1218d604 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:35.939764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6ed6b-131d-4938-baf0-881e1218d604 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:35.940179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6ed6b-131d-4938-baf0-881e1218d604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:35.941994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6ed6b-131d-4938-baf0-881e1218d604 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:35.959871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 67/128] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:58:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:35.960568 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6ed6b-131d-4938-baf0-881e1218d604 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:36.007817 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f99d46-6cd9-41e4-b687-6d57f5fbd1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:36.008943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f99d46-6cd9-41e4-b687-6d57f5fbd1ca None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.009448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f99d46-6cd9-41e4-b687-6d57f5fbd1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.009928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f99d46-6cd9-41e4-b687-6d57f5fbd1ca None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.011003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f99d46-6cd9-41e4-b687-6d57f5fbd1ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:36.011702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f99d46-6cd9-41e4-b687-6d57f5fbd1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:36.014087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f99d46-6cd9-41e4-b687-6d57f5fbd1ca None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:36.033715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 62/129] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:36.034942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f99d46-6cd9-41e4-b687-6d57f5fbd1ca None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:36.063809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6ed6b-131d-4938-baf0-881e1218d604 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:36.100488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27820ee5-bb07-45d8-b60f-c4d96b523053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:36.101397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27820ee5-bb07-45d8-b60f-c4d96b523053 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.101685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27820ee5-bb07-45d8-b60f-c4d96b523053 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.101971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27820ee5-bb07-45d8-b60f-c4d96b523053 None admin] PATH_INFO: `/v3/projects/c952466e04544fe6986a90c22f180537` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.103192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27820ee5-bb07-45d8-b60f-c4d96b523053 None admin] RBAC: Authorizing `identity:get_project(project_id=c952466e04544fe6986a90c22f180537)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:36.104663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27820ee5-bb07-45d8-b60f-c4d96b523053 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:36.106727 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 68/130] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:35 2022] GET /identity/v3/projects/c952466e04544fe6986a90c22f180537 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:36.107597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27820ee5-bb07-45d8-b60f-c4d96b523053 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:36.125646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:36.243067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f99d46-6cd9-41e4-b687-6d57f5fbd1ca None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:36.254913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27820ee5-bb07-45d8-b60f-c4d96b523053 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:36.278147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf72ea-626f-485d-aa42-5b7efc5acabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:36.279043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf72ea-626f-485d-aa42-5b7efc5acabb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.279329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf72ea-626f-485d-aa42-5b7efc5acabb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.279617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf72ea-626f-485d-aa42-5b7efc5acabb None admin] PATH_INFO: `/v3/users/9d87e4186e5d4797a064a0e3092c629d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.280844 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf72ea-626f-485d-aa42-5b7efc5acabb None admin] RBAC: Authorizing `identity:get_user(user_id=9d87e4186e5d4797a064a0e3092c629d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:36.282529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf72ea-626f-485d-aa42-5b7efc5acabb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:36.284648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 63/131] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:36 2022] GET /identity/v3/users/9d87e4186e5d4797a064a0e3092c629d => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:36.285560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf72ea-626f-485d-aa42-5b7efc5acabb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:36.329625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:36.357528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f38e8d-4449-4989-aa24-c99cad933973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:36.358486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f38e8d-4449-4989-aa24-c99cad933973 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.358773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f38e8d-4449-4989-aa24-c99cad933973 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.359064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f38e8d-4449-4989-aa24-c99cad933973 None admin] PATH_INFO: `/v3/users/a2fa31ddd5e14c2dba5028b21c5db486` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.360343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f38e8d-4449-4989-aa24-c99cad933973 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fa31ddd5e14c2dba5028b21c5db486)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:36.361870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f38e8d-4449-4989-aa24-c99cad933973 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:36.363606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 69/132] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:36 2022] GET /identity/v3/users/a2fa31ddd5e14c2dba5028b21c5db486 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:36.364402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f38e8d-4449-4989-aa24-c99cad933973 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:36.424018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf72ea-626f-485d-aa42-5b7efc5acabb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:36.494646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f829718-be11-42bc-9fb6-8d6ba16db63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:36.495518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f829718-be11-42bc-9fb6-8d6ba16db63b None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.495912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f829718-be11-42bc-9fb6-8d6ba16db63b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.496917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f829718-be11-42bc-9fb6-8d6ba16db63b None admin] PATH_INFO: `/v3/projects/c952466e04544fe6986a90c22f180537/users/9d87e4186e5d4797a064a0e3092c629d/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.505260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f829718-be11-42bc-9fb6-8d6ba16db63b None admin] RBAC: Authorizing `identity:create_grant(project_id=c952466e04544fe6986a90c22f180537, user_id=9d87e4186e5d4797a064a0e3092c629d, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:36.506841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f829718-be11-42bc-9fb6-8d6ba16db63b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:36.521225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:36.538275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 64/133] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:58:36 2022] PUT /identity/v3/projects/c952466e04544fe6986a90c22f180537/users/9d87e4186e5d4797a064a0e3092c629d/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:58:36.539293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f829718-be11-42bc-9fb6-8d6ba16db63b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:36.566538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f38e8d-4449-4989-aa24-c99cad933973 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:36.619750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdce4ec-3e06-448a-a723-faace6a0548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:36.620649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdce4ec-3e06-448a-a723-faace6a0548b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.621159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdce4ec-3e06-448a-a723-faace6a0548b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.622205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdce4ec-3e06-448a-a723-faace6a0548b None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.623880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdce4ec-3e06-448a-a723-faace6a0548b None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:36.625429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdce4ec-3e06-448a-a723-faace6a0548b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:36.634810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 70/134] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:36 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:36.636187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d9def-5588-46b1-9014-c436666613e4 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.641675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d9def-5588-46b1-9014-c436666613e4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.641675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d9def-5588-46b1-9014-c436666613e4 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.641675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 71/135] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:36.647387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5ec64-904c-4361-ba71-e62eb98f26f8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.647683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5ec64-904c-4361-ba71-e62eb98f26f8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.648028 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5ec64-904c-4361-ba71-e62eb98f26f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.664953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:36.692779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f829718-be11-42bc-9fb6-8d6ba16db63b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:36.697612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-08f5ec64-904c-4361-ba71-e62eb98f26f8 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:36.699042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-08f5ec64-904c-4361-ba71-e62eb98f26f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:36.754607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cec59-a2ee-4bbf-beeb-a131b09f8414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:36.755435 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cec59-a2ee-4bbf-beeb-a131b09f8414 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.755717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cec59-a2ee-4bbf-beeb-a131b09f8414 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.755995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cec59-a2ee-4bbf-beeb-a131b09f8414 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.757528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cec59-a2ee-4bbf-beeb-a131b09f8414 None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:36.759155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cec59-a2ee-4bbf-beeb-a131b09f8414 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:36.761722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 65/136] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:36 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:36.765754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cec59-a2ee-4bbf-beeb-a131b09f8414 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:36.830807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 72/137] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:36.832441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5ec64-904c-4361-ba71-e62eb98f26f8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:36.904428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cec59-a2ee-4bbf-beeb-a131b09f8414 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:36.949367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77ee83-5f63-4021-b6f0-2ba1a62028d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:36.950091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5ec64-904c-4361-ba71-e62eb98f26f8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:36.950665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77ee83-5f63-4021-b6f0-2ba1a62028d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.951111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77ee83-5f63-4021-b6f0-2ba1a62028d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.951865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77ee83-5f63-4021-b6f0-2ba1a62028d1 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009/users/9d87e4186e5d4797a064a0e3092c629d/roles/f36f89c30b0a4c38900202ea156ed20e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.953601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:36.955319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77ee83-5f63-4021-b6f0-2ba1a62028d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=df2e2d29dd144c198fac526f80a50009, user_id=9d87e4186e5d4797a064a0e3092c629d, role_id=f36f89c30b0a4c38900202ea156ed20e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:36.956818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77ee83-5f63-4021-b6f0-2ba1a62028d1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:36.974257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 66/138] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:58:36 2022] PUT /identity/v3/projects/df2e2d29dd144c198fac526f80a50009/users/9d87e4186e5d4797a064a0e3092c629d/roles/f36f89c30b0a4c38900202ea156ed20e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:58:36.976167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8c6b0-78fd-4ac4-ad46-11ce3731c04b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.976537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8c6b0-78fd-4ac4-ad46-11ce3731c04b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.976974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8c6b0-78fd-4ac4-ad46-11ce3731c04b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:36.979049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 67/139] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:36.980442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8c6b0-78fd-4ac4-ad46-11ce3731c04b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:36.985358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:36.995703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc21514-c7b7-42c0-95d1-982affab2805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:36.998516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21514-c7b7-42c0-95d1-982affab2805 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:36.999120 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21514-c7b7-42c0-95d1-982affab2805 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:36.999592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21514-c7b7-42c0-95d1-982affab2805 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009/users/a2fa31ddd5e14c2dba5028b21c5db486/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:37.002756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc21514-c7b7-42c0-95d1-982affab2805 None admin] RBAC: Authorizing `identity:create_grant(project_id=df2e2d29dd144c198fac526f80a50009, user_id=a2fa31ddd5e14c2dba5028b21c5db486, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:37.004228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc21514-c7b7-42c0-95d1-982affab2805 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:37.033545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 73/140] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:58:36 2022] PUT /identity/v3/projects/df2e2d29dd144c198fac526f80a50009/users/a2fa31ddd5e14c2dba5028b21c5db486/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:58:37.034618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e8ec9-8072-4137-8132-586f0b8772c4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:37.034996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e8ec9-8072-4137-8132-586f0b8772c4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:37.035231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e8ec9-8072-4137-8132-586f0b8772c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:37.076077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6a1e8ec9-8072-4137-8132-586f0b8772c4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:37.080507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6a1e8ec9-8072-4137-8132-586f0b8772c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:37.161240 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8c6b0-78fd-4ac4-ad46-11ce3731c04b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:37.170883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 74/141] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:37.193105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e8ec9-8072-4137-8132-586f0b8772c4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:37.202142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcc96d-d592-4af4-918e-5d8879973a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:37.202955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc96d-d592-4af4-918e-5d8879973a22 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:37.203236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc96d-d592-4af4-918e-5d8879973a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:37.203515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc96d-d592-4af4-918e-5d8879973a22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:37.204776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcc96d-d592-4af4-918e-5d8879973a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:37.206372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcc96d-d592-4af4-918e-5d8879973a22 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:37.208339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 68/142] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:37.213865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcc96d-d592-4af4-918e-5d8879973a22 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:37.306973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:37.335347 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcc96d-d592-4af4-918e-5d8879973a22 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:37.343267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:37.382182 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfc884-88d4-429c-b12a-de0ee2a1cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:37.382955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfc884-88d4-429c-b12a-de0ee2a1cd4c None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:37.383251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfc884-88d4-429c-b12a-de0ee2a1cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:37.383538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfc884-88d4-429c-b12a-de0ee2a1cd4c None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:37.384396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfc884-88d4-429c-b12a-de0ee2a1cd4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:37.386002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfc884-88d4-429c-b12a-de0ee2a1cd4c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:37.419594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 69/143] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:58:37 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 14:58:37.427901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e8ec9-8072-4137-8132-586f0b8772c4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:37.473133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eef4f1-1886-4f37-b13a-27b1101e7281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:37.474479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eef4f1-1886-4f37-b13a-27b1101e7281 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:37.475000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eef4f1-1886-4f37-b13a-27b1101e7281 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:37.475499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eef4f1-1886-4f37-b13a-27b1101e7281 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:37.489771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eef4f1-1886-4f37-b13a-27b1101e7281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c4eef4f1-1886-4f37-b13a-27b1101e7281 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:37.498446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:37.499377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:58:37.500113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:37.503040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 75/144] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:37.510565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfc884-88d4-429c-b12a-de0ee2a1cd4c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:37.646018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfc884-88d4-429c-b12a-de0ee2a1cd4c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:37.676539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:37.690967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e66e0-ee6e-42fc-881e-78a5f75de48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:37.692200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e66e0-ee6e-42fc-881e-78a5f75de48f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:37.692791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e66e0-ee6e-42fc-881e-78a5f75de48f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:37.693362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e66e0-ee6e-42fc-881e-78a5f75de48f None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:37.694730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e66e0-ee6e-42fc-881e-78a5f75de48f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:37.695243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e66e0-ee6e-42fc-881e-78a5f75de48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:37.697484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e66e0-ee6e-42fc-881e-78a5f75de48f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:37.717646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 70/145] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:37.725089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eef4f1-1886-4f37-b13a-27b1101e7281 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:37.869096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eef4f1-1886-4f37-b13a-27b1101e7281 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:37.909643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:37.916967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2bcc6-c84c-490f-b39c-7fd9c232c8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:37.917997 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2bcc6-c84c-490f-b39c-7fd9c232c8ce None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:37.918283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2bcc6-c84c-490f-b39c-7fd9c232c8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:37.918740 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2bcc6-c84c-490f-b39c-7fd9c232c8ce None admin] PATH_INFO: `/v3/users/ec10c91ec43245368f014e6cdc7edf05` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:37.920605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2bcc6-c84c-490f-b39c-7fd9c232c8ce None admin] RBAC: Authorizing `identity:get_user(user_id=ec10c91ec43245368f014e6cdc7edf05)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:37.922118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2bcc6-c84c-490f-b39c-7fd9c232c8ce None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:37.923843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 76/146] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:37 2022] GET /identity/v3/users/ec10c91ec43245368f014e6cdc7edf05 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:37.929423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e66e0-ee6e-42fc-881e-78a5f75de48f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:38.059518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2597d-f8e2-47f4-abb7-930faba83fc0 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:38.059989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2597d-f8e2-47f4-abb7-930faba83fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:38.060482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2597d-f8e2-47f4-abb7-930faba83fc0 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:38.063130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 77/147] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:38.073532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e66e0-ee6e-42fc-881e-78a5f75de48f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:38.080589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55469c-5f30-4e1e-af20-0a299265838f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:38.080884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55469c-5f30-4e1e-af20-0a299265838f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:38.081152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55469c-5f30-4e1e-af20-0a299265838f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:38.121415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377bed3-3d48-41d4-a978-52fa56ac6d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:38.122449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377bed3-3d48-41d4-a978-52fa56ac6d23 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:38.122725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377bed3-3d48-41d4-a978-52fa56ac6d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:38.122999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377bed3-3d48-41d4-a978-52fa56ac6d23 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:38.124447 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8f55469c-5f30-4e1e-af20-0a299265838f None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:38.126123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377bed3-3d48-41d4-a978-52fa56ac6d23 None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:38.127637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377bed3-3d48-41d4-a978-52fa56ac6d23 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:38.129079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8f55469c-5f30-4e1e-af20-0a299265838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:38.132137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 71/148] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:37 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:38.142174 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377bed3-3d48-41d4-a978-52fa56ac6d23 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:38.237747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:38.275020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 78/149] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:38.305752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377bed3-3d48-41d4-a978-52fa56ac6d23 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:38.328729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55469c-5f30-4e1e-af20-0a299265838f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:38.357983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b288-eb55-414d-9b53-4931ebe7a95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:38.359208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b288-eb55-414d-9b53-4931ebe7a95f None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:38.359492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b288-eb55-414d-9b53-4931ebe7a95f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:38.359769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b288-eb55-414d-9b53-4931ebe7a95f None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009/users/ec10c91ec43245368f014e6cdc7edf05/roles/16a382e27714463d91383877be17fa0a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:38.362468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7b288-eb55-414d-9b53-4931ebe7a95f None admin] RBAC: Authorizing `identity:create_grant(project_id=df2e2d29dd144c198fac526f80a50009, user_id=ec10c91ec43245368f014e6cdc7edf05, role_id=16a382e27714463d91383877be17fa0a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:38.363949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7b288-eb55-414d-9b53-4931ebe7a95f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:38.385037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 72/150] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:58:38 2022] PUT /identity/v3/projects/df2e2d29dd144c198fac526f80a50009/users/ec10c91ec43245368f014e6cdc7edf05/roles/16a382e27714463d91383877be17fa0a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:58:38.473537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55469c-5f30-4e1e-af20-0a299265838f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:38.508861 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:38.519600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a325c-f7c6-4291-b197-6bf2c96b5754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:38.520423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a325c-f7c6-4291-b197-6bf2c96b5754 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:38.520707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a325c-f7c6-4291-b197-6bf2c96b5754 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:38.520984 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a325c-f7c6-4291-b197-6bf2c96b5754 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:38.534323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a325c-f7c6-4291-b197-6bf2c96b5754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-be5a325c-f7c6-4291-b197-6bf2c96b5754 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:38.542722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:38.543742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:38.544571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 79/151] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:58:38.550755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b288-eb55-414d-9b53-4931ebe7a95f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:38.692669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b288-eb55-414d-9b53-4931ebe7a95f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:38.715945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:38.738910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbebf7-14bd-4651-96c7-f382012963fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:38.739605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbebf7-14bd-4651-96c7-f382012963fa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:38.739891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbebf7-14bd-4651-96c7-f382012963fa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:38.740171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbebf7-14bd-4651-96c7-f382012963fa None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:38.740945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbebf7-14bd-4651-96c7-f382012963fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:38.741276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbebf7-14bd-4651-96c7-f382012963fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:38.742726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbebf7-14bd-4651-96c7-f382012963fa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:38.755130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 73/152] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:38.760875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a325c-f7c6-4291-b197-6bf2c96b5754 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:38.894690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a325c-f7c6-4291-b197-6bf2c96b5754 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:38.931530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb96221-55ed-4307-9e89-922b35d26e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:38.932420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb96221-55ed-4307-9e89-922b35d26e9b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:38.932701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb96221-55ed-4307-9e89-922b35d26e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:38.932979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb96221-55ed-4307-9e89-922b35d26e9b None admin] PATH_INFO: `/v3/users/9d87e4186e5d4797a064a0e3092c629d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:38.934803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb96221-55ed-4307-9e89-922b35d26e9b None admin] RBAC: Authorizing `identity:get_user(user_id=9d87e4186e5d4797a064a0e3092c629d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:38.936332 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb96221-55ed-4307-9e89-922b35d26e9b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:38.938040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 80/153] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:38 2022] GET /identity/v3/users/9d87e4186e5d4797a064a0e3092c629d => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:38.943672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbebf7-14bd-4651-96c7-f382012963fa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:39.056282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbebf7-14bd-4651-96c7-f382012963fa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:39.094010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc95cf-eb76-4606-8ea0-8bbb8f188fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:39.094676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc95cf-eb76-4606-8ea0-8bbb8f188fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:39.094959 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc95cf-eb76-4606-8ea0-8bbb8f188fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:39.095242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc95cf-eb76-4606-8ea0-8bbb8f188fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:39.154705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:39.176997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc95cf-eb76-4606-8ea0-8bbb8f188fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:39.178534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc95cf-eb76-4606-8ea0-8bbb8f188fc5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:39.296804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 74/154] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:39.302483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb96221-55ed-4307-9e89-922b35d26e9b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:39.373428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:39.424258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb96221-55ed-4307-9e89-922b35d26e9b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:39.464748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dd15a-8ee4-490b-a5d5-273043657aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:39.465829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dd15a-8ee4-490b-a5d5-273043657aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:39.466114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dd15a-8ee4-490b-a5d5-273043657aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:39.466392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dd15a-8ee4-490b-a5d5-273043657aa6 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:39.467628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dd15a-8ee4-490b-a5d5-273043657aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:39.469083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dd15a-8ee4-490b-a5d5-273043657aa6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:39.471041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 81/155] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:39 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:39.476858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc95cf-eb76-4606-8ea0-8bbb8f188fc5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:39.577327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:39.599390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc95cf-eb76-4606-8ea0-8bbb8f188fc5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:39.645264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810ef18-602b-4f97-843e-dec0214839e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:39.645877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ef18-602b-4f97-843e-dec0214839e3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:39.646211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ef18-602b-4f97-843e-dec0214839e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:39.646504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ef18-602b-4f97-843e-dec0214839e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:39.647353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810ef18-602b-4f97-843e-dec0214839e3 None admin] RBAC: Adding query filter params (role.id=2b2ea3ada01041ad941dd5b6721df5b2, scope.project.id=df2e2d29dd144c198fac526f80a50009, user.id=9d87e4186e5d4797a064a0e3092c629d) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:39.647671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810ef18-602b-4f97-843e-dec0214839e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:39.649168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810ef18-602b-4f97-843e-dec0214839e3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:39.660260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 75/156] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:39 2022] GET /identity/v3/role_assignments?user.id=9d87e4186e5d4797a064a0e3092c629d&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:40.211924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc44486-fa04-4e19-b660-93efa5a5c011 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:40.212451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc44486-fa04-4e19-b660-93efa5a5c011 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:40.212451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc44486-fa04-4e19-b660-93efa5a5c011 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:40.213918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 82/157] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:40.219743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7ace-0e7d-4a73-9492-7965198ed317 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:40.220353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7ace-0e7d-4a73-9492-7965198ed317 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:40.220353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7ace-0e7d-4a73-9492-7965198ed317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:40.247321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a21f7ace-0e7d-4a73-9492-7965198ed317 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:40.248658 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a21f7ace-0e7d-4a73-9492-7965198ed317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:40.340223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 76/158] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:40.393265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc44486-fa04-4e19-b660-93efa5a5c011 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:40.528620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc44486-fa04-4e19-b660-93efa5a5c011 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:40.561823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:40.575500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eeb6c-7f81-4853-b3cf-48e88f58b7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:40.576310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eeb6c-7f81-4853-b3cf-48e88f58b7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:40.576908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eeb6c-7f81-4853-b3cf-48e88f58b7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:40.577187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eeb6c-7f81-4853-b3cf-48e88f58b7a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:40.596091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eeb6c-7f81-4853-b3cf-48e88f58b7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-622eeb6c-7f81-4853-b3cf-48e88f58b7a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:40.604033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:40.605091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:40.606084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 83/159] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:40.614332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7ace-0e7d-4a73-9492-7965198ed317 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:40.707541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:40.737943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7ace-0e7d-4a73-9492-7965198ed317 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:40.790047 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a9a45-05b2-4c62-8fd3-69d3c5430cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:40.791070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a9a45-05b2-4c62-8fd3-69d3c5430cab None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:40.791544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a9a45-05b2-4c62-8fd3-69d3c5430cab None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:40.792007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a9a45-05b2-4c62-8fd3-69d3c5430cab None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:40.793246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a9a45-05b2-4c62-8fd3-69d3c5430cab None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:40.793565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a9a45-05b2-4c62-8fd3-69d3c5430cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:40.797254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a9a45-05b2-4c62-8fd3-69d3c5430cab None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:40.804610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 77/160] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:40.810115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eeb6c-7f81-4853-b3cf-48e88f58b7a8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:40.951921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eeb6c-7f81-4853-b3cf-48e88f58b7a8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:40.996546 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d763b-c19d-4ad8-be37-6bec1e841220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:40.998033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d763b-c19d-4ad8-be37-6bec1e841220 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:40.998540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d763b-c19d-4ad8-be37-6bec1e841220 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:40.999012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d763b-c19d-4ad8-be37-6bec1e841220 None admin] PATH_INFO: `/v3/users/9d87e4186e5d4797a064a0e3092c629d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:41.000448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d763b-c19d-4ad8-be37-6bec1e841220 None admin] RBAC: Authorizing `identity:get_user(user_id=9d87e4186e5d4797a064a0e3092c629d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:41.002128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d763b-c19d-4ad8-be37-6bec1e841220 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:41.003964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 84/161] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:40 2022] GET /identity/v3/users/9d87e4186e5d4797a064a0e3092c629d => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:41.009600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a9a45-05b2-4c62-8fd3-69d3c5430cab None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:41.082838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba24a03-fc6c-4e51-8901-a8645d11dc44 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:41.083451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba24a03-fc6c-4e51-8901-a8645d11dc44 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:41.083923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba24a03-fc6c-4e51-8901-a8645d11dc44 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:41.085812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 85/162] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:41.091809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52aabf-9c7d-4dec-8427-1aec5e32e503 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:41.092320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52aabf-9c7d-4dec-8427-1aec5e32e503 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:41.092811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52aabf-9c7d-4dec-8427-1aec5e32e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:41.122270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-df52aabf-9c7d-4dec-8427-1aec5e32e503 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:41.123791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-df52aabf-9c7d-4dec-8427-1aec5e32e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:41.163003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a9a45-05b2-4c62-8fd3-69d3c5430cab None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:41.211576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0aa1a-afc6-4935-ae24-265828528c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:41.212247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0aa1a-afc6-4935-ae24-265828528c2f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:41.212531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0aa1a-afc6-4935-ae24-265828528c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:41.212808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0aa1a-afc6-4935-ae24-265828528c2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:41.220635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:41.257320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:41.296406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 86/163] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:41.318178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0aa1a-afc6-4935-ae24-265828528c2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:41.319915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0aa1a-afc6-4935-ae24-265828528c2f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:41.333585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52aabf-9c7d-4dec-8427-1aec5e32e503 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:41.436617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 78/164] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:41.443880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0aa1a-afc6-4935-ae24-265828528c2f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:41.513828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:41.543126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52aabf-9c7d-4dec-8427-1aec5e32e503 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:41.629111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0aa1a-afc6-4935-ae24-265828528c2f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:41.639171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d9638-9664-4cbf-a5ff-ba24bc44fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:41.640422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d9638-9664-4cbf-a5ff-ba24bc44fd5e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:41.640900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d9638-9664-4cbf-a5ff-ba24bc44fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:41.641397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d9638-9664-4cbf-a5ff-ba24bc44fd5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:41.670302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d9638-9664-4cbf-a5ff-ba24bc44fd5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d44d9638-9664-4cbf-a5ff-ba24bc44fd5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:41.678894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:41.679780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:41.680616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:41.691575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 87/165] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:58:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:58:41.698295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d9638-9664-4cbf-a5ff-ba24bc44fd5e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:41.728461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a264700-d09c-4589-86fd-7b7b80e8775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:41.729706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a264700-d09c-4589-86fd-7b7b80e8775b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:41.729996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a264700-d09c-4589-86fd-7b7b80e8775b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:41.730387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a264700-d09c-4589-86fd-7b7b80e8775b None admin] PATH_INFO: `/v3/projects/c952466e04544fe6986a90c22f180537` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:41.731969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a264700-d09c-4589-86fd-7b7b80e8775b None admin] RBAC: Authorizing `identity:get_project(project_id=c952466e04544fe6986a90c22f180537)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:41.733778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a264700-d09c-4589-86fd-7b7b80e8775b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:41.735744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 79/166] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:41 2022] GET /identity/v3/projects/c952466e04544fe6986a90c22f180537 => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:41.742542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a264700-d09c-4589-86fd-7b7b80e8775b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:41.803511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:41.979537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d9638-9664-4cbf-a5ff-ba24bc44fd5e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:41.995548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a264700-d09c-4589-86fd-7b7b80e8775b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:42.003167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:42.071589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf6175-ffa0-4c91-aa47-c7732b6151a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:42.072288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf6175-ffa0-4c91-aa47-c7732b6151a0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.072568 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf6175-ffa0-4c91-aa47-c7732b6151a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.072844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf6175-ffa0-4c91-aa47-c7732b6151a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.073635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf6175-ffa0-4c91-aa47-c7732b6151a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:42.074004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf6175-ffa0-4c91-aa47-c7732b6151a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:42.075475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf6175-ffa0-4c91-aa47-c7732b6151a0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:42.092838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 88/167] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:58:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:42.094512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e8dfc-2da4-46c3-8e82-84428a2971ef None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.094936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e8dfc-2da4-46c3-8e82-84428a2971ef None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.098820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e8dfc-2da4-46c3-8e82-84428a2971ef None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.101017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 89/168] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:42.101881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc03349-b394-46dc-94c4-978aa259eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:42.102175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e8dfc-2da4-46c3-8e82-84428a2971ef None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:42.102576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03349-b394-46dc-94c4-978aa259eb9c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.102931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03349-b394-46dc-94c4-978aa259eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.103201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03349-b394-46dc-94c4-978aa259eb9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.103969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03349-b394-46dc-94c4-978aa259eb9c None admin] RBAC: Adding query filter params (role.id=2b2ea3ada01041ad941dd5b6721df5b2, scope.project.id=c952466e04544fe6986a90c22f180537, user.id=9d87e4186e5d4797a064a0e3092c629d) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:42.104276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03349-b394-46dc-94c4-978aa259eb9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:42.106237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03349-b394-46dc-94c4-978aa259eb9c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:42.128961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 80/169] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:41 2022] GET /identity/v3/role_assignments?user.id=9d87e4186e5d4797a064a0e3092c629d&scope.project.id=c952466e04544fe6986a90c22f180537&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 608 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:42.131143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01be8-f57a-43e0-8f76-7cfe099621fa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.131616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01be8-f57a-43e0-8f76-7cfe099621fa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.132086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01be8-f57a-43e0-8f76-7cfe099621fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.174533 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8fa01be8-f57a-43e0-8f76-7cfe099621fa None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:42.175875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8fa01be8-f57a-43e0-8f76-7cfe099621fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:42.338981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e8dfc-2da4-46c3-8e82-84428a2971ef None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:42.339633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 81/170] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:42.341393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7547b0-925f-40c3-a438-132a66115701 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.341686 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7547b0-925f-40c3-a438-132a66115701 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.341969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7547b0-925f-40c3-a438-132a66115701 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.347819 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:42.348850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 82/171] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:42.350746 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a846e0-8ef8-4898-9e39-7ba0ca997d99 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.351220 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a846e0-8ef8-4898-9e39-7ba0ca997d99 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.351510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a846e0-8ef8-4898-9e39-7ba0ca997d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.378036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-86a846e0-8ef8-4898-9e39-7ba0ca997d99 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:42.379259 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-86a846e0-8ef8-4898-9e39-7ba0ca997d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:42.419837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e80c-4013-432c-9018-2a531cf33939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:42.420741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e80c-4013-432c-9018-2a531cf33939 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.421022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e80c-4013-432c-9018-2a531cf33939 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.421330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e80c-4013-432c-9018-2a531cf33939 None admin] PATH_INFO: `/v3/users/9d87e4186e5d4797a064a0e3092c629d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.422638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487e80c-4013-432c-9018-2a531cf33939 None admin] RBAC: Authorizing `identity:get_user(user_id=9d87e4186e5d4797a064a0e3092c629d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:42.424097 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487e80c-4013-432c-9018-2a531cf33939 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:42.425968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 90/172] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:42 2022] GET /identity/v3/users/9d87e4186e5d4797a064a0e3092c629d => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:42.430309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e80c-4013-432c-9018-2a531cf33939 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:42.536771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 83/173] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:42.541346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a846e0-8ef8-4898-9e39-7ba0ca997d99 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:42.621440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:42.635886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e80c-4013-432c-9018-2a531cf33939 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:42.687578 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27632f9-ab7e-454c-b4b6-2bbf0c6d9b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:42.688410 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27632f9-ab7e-454c-b4b6-2bbf0c6d9b2d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.688693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27632f9-ab7e-454c-b4b6-2bbf0c6d9b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.688973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27632f9-ab7e-454c-b4b6-2bbf0c6d9b2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.705147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27632f9-ab7e-454c-b4b6-2bbf0c6d9b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b27632f9-ab7e-454c-b4b6-2bbf0c6d9b2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:42.713279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:42.714184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:42.714994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 91/174] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:42.716398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb196e-b8c8-42c3-9747-867fbf5d6b10 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.716398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb196e-b8c8-42c3-9747-867fbf5d6b10 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.716398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb196e-b8c8-42c3-9747-867fbf5d6b10 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.717971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 92/175] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:42.718614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb196e-b8c8-42c3-9747-867fbf5d6b10 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:42.737174 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a846e0-8ef8-4898-9e39-7ba0ca997d99 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:42.755911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:42.780844 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62069aac-b6bc-4747-9919-3e8e6557bb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:42.781862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62069aac-b6bc-4747-9919-3e8e6557bb10 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.782306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62069aac-b6bc-4747-9919-3e8e6557bb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.782679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62069aac-b6bc-4747-9919-3e8e6557bb10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.868160 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb196e-b8c8-42c3-9747-867fbf5d6b10 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:42.875178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62069aac-b6bc-4747-9919-3e8e6557bb10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:42.876601 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62069aac-b6bc-4747-9919-3e8e6557bb10 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:42.905756 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:42.909377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ad06b-4cb0-4416-ae74-b334474243f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:42.910261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad06b-4cb0-4416-ae74-b334474243f6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.910580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad06b-4cb0-4416-ae74-b334474243f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.910797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad06b-4cb0-4416-ae74-b334474243f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.923884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ad06b-4cb0-4416-ae74-b334474243f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0e5ad06b-4cb0-4416-ae74-b334474243f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:42.932195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:42.933055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 93/176] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:42.939053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8d28-5ef5-4a0e-ab81-a995d86ee2f5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.939908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8d28-5ef5-4a0e-ab81-a995d86ee2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.939908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8d28-5ef5-4a0e-ab81-a995d86ee2f5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:42.939908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 94/177] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:42.941057 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e8d28-5ef5-4a0e-ab81-a995d86ee2f5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:42.994425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 84/178] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:42.994425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f309b0b-2e2c-4a09-a161-0b7fa97ad11c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:42.994425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f309b0b-2e2c-4a09-a161-0b7fa97ad11c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:42.994425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f309b0b-2e2c-4a09-a161-0b7fa97ad11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.008179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8f309b0b-2e2c-4a09-a161-0b7fa97ad11c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:43.009408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8f309b0b-2e2c-4a09-a161-0b7fa97ad11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:43.050915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:43.067950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e8d28-5ef5-4a0e-ab81-a995d86ee2f5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:43.086732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 85/179] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:43.087617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f309b0b-2e2c-4a09-a161-0b7fa97ad11c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:43.126578 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a802308-1b55-40f3-82d2-2a87901c6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:43.127580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a802308-1b55-40f3-82d2-2a87901c6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.128050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a802308-1b55-40f3-82d2-2a87901c6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.128504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a802308-1b55-40f3-82d2-2a87901c6ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.129833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a802308-1b55-40f3-82d2-2a87901c6ae9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:43.130336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a802308-1b55-40f3-82d2-2a87901c6ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:43.132681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a802308-1b55-40f3-82d2-2a87901c6ae9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:43.143658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 95/180] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:43.145150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c5b4d-0983-4d5a-a04c-a7844122d1da None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.145483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c5b4d-0983-4d5a-a04c-a7844122d1da None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.145762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c5b4d-0983-4d5a-a04c-a7844122d1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.162699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3d4c5b4d-0983-4d5a-a04c-a7844122d1da None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:43.163922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3d4c5b4d-0983-4d5a-a04c-a7844122d1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:43.165251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:43.217868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f309b0b-2e2c-4a09-a161-0b7fa97ad11c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:43.238018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 96/181] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:43.249428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c5b4d-0983-4d5a-a04c-a7844122d1da None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:43.269638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebccdd-65c9-4ad4-90c9-852b35059606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:43.270325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebccdd-65c9-4ad4-90c9-852b35059606 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.270600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebccdd-65c9-4ad4-90c9-852b35059606 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.270871 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebccdd-65c9-4ad4-90c9-852b35059606 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.271653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebccdd-65c9-4ad4-90c9-852b35059606 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:43.271957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebccdd-65c9-4ad4-90c9-852b35059606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:43.273410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebccdd-65c9-4ad4-90c9-852b35059606 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:43.287597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 86/182] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:43.288524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebccdd-65c9-4ad4-90c9-852b35059606 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:43.337669 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:43.357175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c5b4d-0983-4d5a-a04c-a7844122d1da None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:43.396882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfedf43-82ce-4a6c-a751-7d4e7d83e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:43.397713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfedf43-82ce-4a6c-a751-7d4e7d83e85c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.398016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfedf43-82ce-4a6c-a751-7d4e7d83e85c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.398277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfedf43-82ce-4a6c-a751-7d4e7d83e85c None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.399557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfedf43-82ce-4a6c-a751-7d4e7d83e85c None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:43.401038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfedf43-82ce-4a6c-a751-7d4e7d83e85c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:43.402936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 97/183] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:43 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:43.404159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9557ea3-20b0-43cd-a77a-26e4f3cf1382 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.404452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9557ea3-20b0-43cd-a77a-26e4f3cf1382 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.404722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9557ea3-20b0-43cd-a77a-26e4f3cf1382 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.406015 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 98/184] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:43.413280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9557ea3-20b0-43cd-a77a-26e4f3cf1382 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:43.416491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebccdd-65c9-4ad4-90c9-852b35059606 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:43.439612 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:43.457175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f1f12-15c9-49a3-af6c-c06c6002e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:43.457649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f1f12-15c9-49a3-af6c-c06c6002e750 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.457755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f1f12-15c9-49a3-af6c-c06c6002e750 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.457986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f1f12-15c9-49a3-af6c-c06c6002e750 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.469284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f1f12-15c9-49a3-af6c-c06c6002e750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-500f1f12-15c9-49a3-af6c-c06c6002e750 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:43.477037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:43.478114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:43.479031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 87/185] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:58:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:43.481130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f1f12-15c9-49a3-af6c-c06c6002e750 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:43.536289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9557ea3-20b0-43cd-a77a-26e4f3cf1382 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:43.574360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7807185-4394-4f1f-9bcc-00631184af26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:43.575300 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7807185-4394-4f1f-9bcc-00631184af26 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.575577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7807185-4394-4f1f-9bcc-00631184af26 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.575845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7807185-4394-4f1f-9bcc-00631184af26 None admin] PATH_INFO: `/v3/users/a2fa31ddd5e14c2dba5028b21c5db486` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.577494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7807185-4394-4f1f-9bcc-00631184af26 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fa31ddd5e14c2dba5028b21c5db486)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:43.578952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7807185-4394-4f1f-9bcc-00631184af26 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:43.580622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 99/186] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:43 2022] GET /identity/v3/users/a2fa31ddd5e14c2dba5028b21c5db486 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:43.581413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7807185-4394-4f1f-9bcc-00631184af26 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:43.604475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:43.611540 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f1f12-15c9-49a3-af6c-c06c6002e750 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:43.648951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd340b23-707e-4c5d-9981-b2c35bfcab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:43.649724 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd340b23-707e-4c5d-9981-b2c35bfcab25 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.650007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd340b23-707e-4c5d-9981-b2c35bfcab25 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.650279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd340b23-707e-4c5d-9981-b2c35bfcab25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.660766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd340b23-707e-4c5d-9981-b2c35bfcab25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cd340b23-707e-4c5d-9981-b2c35bfcab25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:43.669162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:43.670290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 88/187] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:58:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:43.676072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd340b23-707e-4c5d-9981-b2c35bfcab25 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:43.685879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7807185-4394-4f1f-9bcc-00631184af26 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:43.718700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:43.722078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba651888-da5b-4154-9efa-bb081b6bbe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:43.723038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba651888-da5b-4154-9efa-bb081b6bbe1a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.723316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba651888-da5b-4154-9efa-bb081b6bbe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.723585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba651888-da5b-4154-9efa-bb081b6bbe1a None admin] PATH_INFO: `/v3/users/ec10c91ec43245368f014e6cdc7edf05` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.724799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba651888-da5b-4154-9efa-bb081b6bbe1a None admin] RBAC: Authorizing `identity:get_user(user_id=ec10c91ec43245368f014e6cdc7edf05)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:43.726299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba651888-da5b-4154-9efa-bb081b6bbe1a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:43.733226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 100/188] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:43 2022] GET /identity/v3/users/ec10c91ec43245368f014e6cdc7edf05 => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:43.733226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e07c17-4ef9-4e43-8177-6c80db3d8ebb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.733226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e07c17-4ef9-4e43-8177-6c80db3d8ebb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.733226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e07c17-4ef9-4e43-8177-6c80db3d8ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.746272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-71e07c17-4ef9-4e43-8177-6c80db3d8ebb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:43.747658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-71e07c17-4ef9-4e43-8177-6c80db3d8ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:43.791081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd340b23-707e-4c5d-9981-b2c35bfcab25 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:43.819918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 101/189] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:43.820588 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e07c17-4ef9-4e43-8177-6c80db3d8ebb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:43.836142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbfaee-d776-4a08-a25e-a14f8fead97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:43.836935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbfaee-d776-4a08-a25e-a14f8fead97b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.837319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbfaee-d776-4a08-a25e-a14f8fead97b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.837667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbfaee-d776-4a08-a25e-a14f8fead97b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.838601 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbfaee-d776-4a08-a25e-a14f8fead97b None admin] RBAC: Adding query filter params (role.id=f36f89c30b0a4c38900202ea156ed20e, scope.project.id=df2e2d29dd144c198fac526f80a50009, user.id=9d87e4186e5d4797a064a0e3092c629d) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:43.838986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbfaee-d776-4a08-a25e-a14f8fead97b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:43.840614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbfaee-d776-4a08-a25e-a14f8fead97b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:43.846482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:43.847398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 89/190] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:43 2022] GET /identity/v3/role_assignments?user.id=9d87e4186e5d4797a064a0e3092c629d&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=f36f89c30b0a4c38900202ea156ed20e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:43.848355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbfaee-d776-4a08-a25e-a14f8fead97b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:43.946997 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e07c17-4ef9-4e43-8177-6c80db3d8ebb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:43.969422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbfaee-d776-4a08-a25e-a14f8fead97b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:43.972087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:43.990565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d028df-1650-4870-a3c7-079fab9f0655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:43.991266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d028df-1650-4870-a3c7-079fab9f0655 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:43.991539 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d028df-1650-4870-a3c7-079fab9f0655 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:43.991809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d028df-1650-4870-a3c7-079fab9f0655 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:43.992605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d028df-1650-4870-a3c7-079fab9f0655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:43.992907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d028df-1650-4870-a3c7-079fab9f0655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:43.994596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d028df-1650-4870-a3c7-079fab9f0655 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:44.009253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 102/191] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:44.009253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d028df-1650-4870-a3c7-079fab9f0655 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:44.016960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01494a08-ca21-4bbf-8282-e8cb3484c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:44.017682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494a08-ca21-4bbf-8282-e8cb3484c6dd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:44.017965 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494a08-ca21-4bbf-8282-e8cb3484c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:44.018249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494a08-ca21-4bbf-8282-e8cb3484c6dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:44.103807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:44.108331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01494a08-ca21-4bbf-8282-e8cb3484c6dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:44.110075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01494a08-ca21-4bbf-8282-e8cb3484c6dd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:44.125749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d028df-1650-4870-a3c7-079fab9f0655 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:44.159079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45852-7f1d-4f5f-aff3-8ce4a7cae341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:44.159746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45852-7f1d-4f5f-aff3-8ce4a7cae341 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:44.160022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45852-7f1d-4f5f-aff3-8ce4a7cae341 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:44.160295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45852-7f1d-4f5f-aff3-8ce4a7cae341 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:44.161027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45852-7f1d-4f5f-aff3-8ce4a7cae341 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:44.161367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45852-7f1d-4f5f-aff3-8ce4a7cae341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:44.162743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45852-7f1d-4f5f-aff3-8ce4a7cae341 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:44.171127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 103/192] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:58:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:44.171800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45852-7f1d-4f5f-aff3-8ce4a7cae341 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:44.216509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 90/193] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:44.217051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01494a08-ca21-4bbf-8282-e8cb3484c6dd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:44.222123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:44.283553 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45852-7f1d-4f5f-aff3-8ce4a7cae341 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:44.320546 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdfa1c-c58c-428a-a13e-7b921ffe17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:44.321341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdfa1c-c58c-428a-a13e-7b921ffe17b3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:44.321635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdfa1c-c58c-428a-a13e-7b921ffe17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:44.321895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdfa1c-c58c-428a-a13e-7b921ffe17b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:44.335064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:44.338885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01494a08-ca21-4bbf-8282-e8cb3484c6dd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:44.376716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12038dcc-1fd6-4ec7-b69e-65991f5aeaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:44.377562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038dcc-1fd6-4ec7-b69e-65991f5aeaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:44.377841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038dcc-1fd6-4ec7-b69e-65991f5aeaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:44.378115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038dcc-1fd6-4ec7-b69e-65991f5aeaf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:44.379377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12038dcc-1fd6-4ec7-b69e-65991f5aeaf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:44.380838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12038dcc-1fd6-4ec7-b69e-65991f5aeaf9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:44.382499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 91/194] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:44.387867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12038dcc-1fd6-4ec7-b69e-65991f5aeaf9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:44.392573 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdfa1c-c58c-428a-a13e-7b921ffe17b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:44.394091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdfa1c-c58c-428a-a13e-7b921ffe17b3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:44.457478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:44.495874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12038dcc-1fd6-4ec7-b69e-65991f5aeaf9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:44.501247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 104/195] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:44.501950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdfa1c-c58c-428a-a13e-7b921ffe17b3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:44.543599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25540117-48a2-43eb-9999-ca56e67243d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:44.544490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25540117-48a2-43eb-9999-ca56e67243d8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:44.544913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25540117-48a2-43eb-9999-ca56e67243d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:44.545252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25540117-48a2-43eb-9999-ca56e67243d8 None admin] PATH_INFO: `/v3/users/c5c2339e4a0741d79dbb687afcece214` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:44.549876 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:44.560720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25540117-48a2-43eb-9999-ca56e67243d8 None admin] RBAC: Authorizing `identity:get_user(user_id=c5c2339e4a0741d79dbb687afcece214)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:44.562272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25540117-48a2-43eb-9999-ca56e67243d8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:44.564034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 92/196] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:44 2022] GET /identity/v3/users/c5c2339e4a0741d79dbb687afcece214 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:44.569042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25540117-48a2-43eb-9999-ca56e67243d8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:44.615965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdfa1c-c58c-428a-a13e-7b921ffe17b3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:44.655927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaf212-c8be-442d-bcbb-1c0d3f5325c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:44.657441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf212-c8be-442d-bcbb-1c0d3f5325c3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:44.657914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf212-c8be-442d-bcbb-1c0d3f5325c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:44.658349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf212-c8be-442d-bcbb-1c0d3f5325c3 None admin] PATH_INFO: `/v3/users/c5c2339e4a0741d79dbb687afcece214` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:44.660556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaf212-c8be-442d-bcbb-1c0d3f5325c3 None admin] RBAC: Authorizing `identity:get_user(user_id=c5c2339e4a0741d79dbb687afcece214)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:44.663184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaf212-c8be-442d-bcbb-1c0d3f5325c3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:44.666330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 105/197] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:44 2022] GET /identity/v3/users/c5c2339e4a0741d79dbb687afcece214 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:44.667856 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaf212-c8be-442d-bcbb-1c0d3f5325c3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:44.711935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25540117-48a2-43eb-9999-ca56e67243d8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:44.743728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:44.751666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a53761-923c-4899-a3da-fec124d40892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:44.752515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a53761-923c-4899-a3da-fec124d40892 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:44.752798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a53761-923c-4899-a3da-fec124d40892 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:44.753077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a53761-923c-4899-a3da-fec124d40892 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:44.754365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a53761-923c-4899-a3da-fec124d40892 None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:44.755855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a53761-923c-4899-a3da-fec124d40892 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:44.757638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 93/198] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:44 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:44.758506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a53761-923c-4899-a3da-fec124d40892 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:44.798039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaf212-c8be-442d-bcbb-1c0d3f5325c3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:44.809737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:44.841390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5112b7-72e5-4a4a-a637-7c91f8732f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:44.842408 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5112b7-72e5-4a4a-a637-7c91f8732f38 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:44.842864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5112b7-72e5-4a4a-a637-7c91f8732f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:44.843297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5112b7-72e5-4a4a-a637-7c91f8732f38 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:44.844418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5112b7-72e5-4a4a-a637-7c91f8732f38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:44.846621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5112b7-72e5-4a4a-a637-7c91f8732f38 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:44.874496 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 106/199] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:58:44 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:44.875604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5112b7-72e5-4a4a-a637-7c91f8732f38 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:44.878139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a53761-923c-4899-a3da-fec124d40892 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:44.931952 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1535dd-6beb-4eac-9ff2-35b535984e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:44.933755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1535dd-6beb-4eac-9ff2-35b535984e45 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:44.934386 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1535dd-6beb-4eac-9ff2-35b535984e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:44.934825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1535dd-6beb-4eac-9ff2-35b535984e45 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:44.936446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1535dd-6beb-4eac-9ff2-35b535984e45 None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:44.938436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1535dd-6beb-4eac-9ff2-35b535984e45 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:44.940433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 94/200] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:44 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:44.942808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1535dd-6beb-4eac-9ff2-35b535984e45 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:45.041670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:45.067293 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5112b7-72e5-4a4a-a637-7c91f8732f38 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:45.095510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1535dd-6beb-4eac-9ff2-35b535984e45 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:45.117741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2d01-4650-46da-9212-dd7a0f8e4f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:45.118697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2d01-4650-46da-9212-dd7a0f8e4f19 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:45.119158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2d01-4650-46da-9212-dd7a0f8e4f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:45.119633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2d01-4650-46da-9212-dd7a0f8e4f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:45.141354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1071f-2ad2-464b-b990-33be087187f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:45.142209 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1071f-2ad2-464b-b990-33be087187f1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:45.142486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1071f-2ad2-464b-b990-33be087187f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:45.142765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1071f-2ad2-464b-b990-33be087187f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:45.166797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:45.217821 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e2d01-4650-46da-9212-dd7a0f8e4f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:45.219336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e2d01-4650-46da-9212-dd7a0f8e4f19 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:45.246589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1071f-2ad2-464b-b990-33be087187f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:45.248718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1071f-2ad2-464b-b990-33be087187f1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:45.350661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:45.362582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 107/201] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:45.363502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2d01-4650-46da-9212-dd7a0f8e4f19 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:45.404042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 95/202] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:45.405446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1071f-2ad2-464b-b990-33be087187f1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:45.442666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:45.498612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2d01-4650-46da-9212-dd7a0f8e4f19 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:45.547227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1071f-2ad2-464b-b990-33be087187f1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:45.553998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9873e6-3fde-40cf-9214-a7dab2bc7e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:45.555086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9873e6-3fde-40cf-9214-a7dab2bc7e58 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:45.555499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9873e6-3fde-40cf-9214-a7dab2bc7e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:45.555951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9873e6-3fde-40cf-9214-a7dab2bc7e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:45.557286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9873e6-3fde-40cf-9214-a7dab2bc7e58 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=df2e2d29dd144c198fac526f80a50009, user.id=a2fa31ddd5e14c2dba5028b21c5db486) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:45.557851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9873e6-3fde-40cf-9214-a7dab2bc7e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:45.561278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9873e6-3fde-40cf-9214-a7dab2bc7e58 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:45.573049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 108/203] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:45 2022] GET /identity/v3/role_assignments?user.id=a2fa31ddd5e14c2dba5028b21c5db486&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=8a6fe5045159487aa0119348cfe94387 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:45.582996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9873e6-3fde-40cf-9214-a7dab2bc7e58 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:45.610770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657c263-443f-4afa-9533-cbd18033769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:45.611905 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657c263-443f-4afa-9533-cbd18033769e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:45.612415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657c263-443f-4afa-9533-cbd18033769e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:45.612868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657c263-443f-4afa-9533-cbd18033769e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:45.615184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657c263-443f-4afa-9533-cbd18033769e None admin] RBAC: Adding query filter params (role.id=16a382e27714463d91383877be17fa0a, scope.project.id=df2e2d29dd144c198fac526f80a50009, user.id=ec10c91ec43245368f014e6cdc7edf05) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:45.615746 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657c263-443f-4afa-9533-cbd18033769e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:45.622247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657c263-443f-4afa-9533-cbd18033769e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:45.638012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 96/204] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:45 2022] GET /identity/v3/role_assignments?user.id=ec10c91ec43245368f014e6cdc7edf05&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=16a382e27714463d91383877be17fa0a => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:45.638916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657c263-443f-4afa-9533-cbd18033769e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:45.729593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:45.832396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9873e6-3fde-40cf-9214-a7dab2bc7e58 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:45.861253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657c263-443f-4afa-9533-cbd18033769e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:45.878727 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:45.889996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03997-9644-4338-8992-46146c27003a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:45.891694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03997-9644-4338-8992-46146c27003a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:45.892191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03997-9644-4338-8992-46146c27003a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:45.892688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03997-9644-4338-8992-46146c27003a None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:45.897454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b03997-9644-4338-8992-46146c27003a None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:45.900307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b03997-9644-4338-8992-46146c27003a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:45.904531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 109/205] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:45 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:45.911087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302afec-2615-4778-b495-7c1e809154cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:45.912274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302afec-2615-4778-b495-7c1e809154cf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:45.912761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302afec-2615-4778-b495-7c1e809154cf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:45.913265 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302afec-2615-4778-b495-7c1e809154cf None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:45.914271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03997-9644-4338-8992-46146c27003a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:45.914982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302afec-2615-4778-b495-7c1e809154cf None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:45.916688 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302afec-2615-4778-b495-7c1e809154cf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:45.919075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 97/206] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:45 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:45.925022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302afec-2615-4778-b495-7c1e809154cf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:46.069396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:46.077373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302afec-2615-4778-b495-7c1e809154cf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:46.083379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03997-9644-4338-8992-46146c27003a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:46.128432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0841b-75de-41f7-aa9c-f0f28d96e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:46.128918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b40b-ffeb-45d3-8601-8b97cadce950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:46.129038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0841b-75de-41f7-aa9c-f0f28d96e577 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:46.129347 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0841b-75de-41f7-aa9c-f0f28d96e577 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:46.129628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0841b-75de-41f7-aa9c-f0f28d96e577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:46.130374 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b40b-ffeb-45d3-8601-8b97cadce950 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:46.130484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0841b-75de-41f7-aa9c-f0f28d96e577 None admin] RBAC: Adding query filter params (role.id=f36f89c30b0a4c38900202ea156ed20e, scope.project.id=346276b0f40e4a0c84018861d282281c, user.id=c5c2339e4a0741d79dbb687afcece214) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:46.130770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0841b-75de-41f7-aa9c-f0f28d96e577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:46.131157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b40b-ffeb-45d3-8601-8b97cadce950 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:46.131621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b40b-ffeb-45d3-8601-8b97cadce950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:46.132253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0841b-75de-41f7-aa9c-f0f28d96e577 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:46.132856 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548b40b-ffeb-45d3-8601-8b97cadce950 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=346276b0f40e4a0c84018861d282281c, user.id=c5c2339e4a0741d79dbb687afcece214) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:46.133404 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548b40b-ffeb-45d3-8601-8b97cadce950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:46.135375 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548b40b-ffeb-45d3-8601-8b97cadce950 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:46.139576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 98/207] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:45 2022] GET /identity/v3/role_assignments?user.id=c5c2339e4a0741d79dbb687afcece214&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=f36f89c30b0a4c38900202ea156ed20e => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:46.143660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 110/208] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:45 2022] GET /identity/v3/role_assignments?user.id=c5c2339e4a0741d79dbb687afcece214&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=8a6fe5045159487aa0119348cfe94387 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:47.517507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76744-d374-4e49-8885-0edbbf695a4f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:47.518548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76744-d374-4e49-8885-0edbbf695a4f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:47.519060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76744-d374-4e49-8885-0edbbf695a4f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:47.520939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 99/209] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:47.526615 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd63cb8-2c2b-47c6-8712-ee15c7c6b844 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:47.527520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd63cb8-2c2b-47c6-8712-ee15c7c6b844 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:47.528176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd63cb8-2c2b-47c6-8712-ee15c7c6b844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:47.546261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6bd63cb8-2c2b-47c6-8712-ee15c7c6b844 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:47.547788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6bd63cb8-2c2b-47c6-8712-ee15c7c6b844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:47.550554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1710937-ffb9-45f5-9e8d-81de45533b1c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:47.550842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1710937-ffb9-45f5-9e8d-81de45533b1c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:47.551120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1710937-ffb9-45f5-9e8d-81de45533b1c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:47.552663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 100/210] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:47.557869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87186ca-ec3e-44b5-8245-e7fc9ce4dcd0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:47.559306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87186ca-ec3e-44b5-8245-e7fc9ce4dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:47.559818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87186ca-ec3e-44b5-8245-e7fc9ce4dcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:47.577299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f87186ca-ec3e-44b5-8245-e7fc9ce4dcd0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:47.578779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f87186ca-ec3e-44b5-8245-e7fc9ce4dcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:47.622639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:47.635501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 111/211] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:47.658526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd63cb8-2c2b-47c6-8712-ee15c7c6b844 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:47.665319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 101/212] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:47.691023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87186ca-ec3e-44b5-8245-e7fc9ce4dcd0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:47.768650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd63cb8-2c2b-47c6-8712-ee15c7c6b844 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:47.820044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac2fb2-5555-4000-aa3d-1d7d8c7c2c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:47.821779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac2fb2-5555-4000-aa3d-1d7d8c7c2c3f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:47.822556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac2fb2-5555-4000-aa3d-1d7d8c7c2c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:47.823057 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac2fb2-5555-4000-aa3d-1d7d8c7c2c3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:47.825604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:47.836790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87186ca-ec3e-44b5-8245-e7fc9ce4dcd0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:47.838399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac2fb2-5555-4000-aa3d-1d7d8c7c2c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-97ac2fb2-5555-4000-aa3d-1d7d8c7c2c3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:47.848897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:47.849852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:47.850623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:47.853273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 112/213] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:58:47.860263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac2fb2-5555-4000-aa3d-1d7d8c7c2c3f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:47.887756 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35ee7e-72f5-475a-908f-9fca2b9098eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:47.888566 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35ee7e-72f5-475a-908f-9fca2b9098eb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:47.888979 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35ee7e-72f5-475a-908f-9fca2b9098eb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:47.889536 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35ee7e-72f5-475a-908f-9fca2b9098eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:47.891182 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35ee7e-72f5-475a-908f-9fca2b9098eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:47.893269 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35ee7e-72f5-475a-908f-9fca2b9098eb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:47.896037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 102/214] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:47.901842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35ee7e-72f5-475a-908f-9fca2b9098eb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:47.937184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:47.990913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac2fb2-5555-4000-aa3d-1d7d8c7c2c3f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:48.030212 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eb015-6490-4f82-ba26-c1d1d6303046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:48.031141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb015-6490-4f82-ba26-c1d1d6303046 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:48.031584 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb015-6490-4f82-ba26-c1d1d6303046 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:48.032002 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb015-6490-4f82-ba26-c1d1d6303046 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:48.032900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eb015-6490-4f82-ba26-c1d1d6303046 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:48.033388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eb015-6490-4f82-ba26-c1d1d6303046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:48.035160 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eb015-6490-4f82-ba26-c1d1d6303046 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:48.035500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35ee7e-72f5-475a-908f-9fca2b9098eb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:48.049823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 113/215] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:48.055949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eb015-6490-4f82-ba26-c1d1d6303046 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:48.084677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edc644-64d8-4e1e-b7a1-4bc44da282e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:48.085657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc644-64d8-4e1e-b7a1-4bc44da282e3 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:48.086253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc644-64d8-4e1e-b7a1-4bc44da282e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:48.086732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc644-64d8-4e1e-b7a1-4bc44da282e3 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:48.087711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edc644-64d8-4e1e-b7a1-4bc44da282e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:48.090374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edc644-64d8-4e1e-b7a1-4bc44da282e3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:48.117458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 103/216] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:58:47 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:48.177674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eb015-6490-4f82-ba26-c1d1d6303046 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:48.194671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:48.217966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f267674-8d6a-4b83-97a0-241f622cf1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:48.218873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f267674-8d6a-4b83-97a0-241f622cf1ed None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:48.219155 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f267674-8d6a-4b83-97a0-241f622cf1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:48.219426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f267674-8d6a-4b83-97a0-241f622cf1ed None admin] PATH_INFO: `/v3/users/33b31775859b40ef9eb3fea67e94fd11` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:48.236126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f267674-8d6a-4b83-97a0-241f622cf1ed None admin] RBAC: Authorizing `identity:get_user(user_id=33b31775859b40ef9eb3fea67e94fd11)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:48.237765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f267674-8d6a-4b83-97a0-241f622cf1ed None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:48.239576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 114/217] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:48 2022] GET /identity/v3/users/33b31775859b40ef9eb3fea67e94fd11 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:48.245443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edc644-64d8-4e1e-b7a1-4bc44da282e3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:48.266853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:48.352524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a59a2-5838-492d-be15-2c40524e1929 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:48.352721 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a59a2-5838-492d-be15-2c40524e1929 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:48.352996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a59a2-5838-492d-be15-2c40524e1929 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:48.354590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 115/218] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:58:48.359678 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724f28c-94fe-4f5e-baf3-c613a4043e02 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:48.359967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724f28c-94fe-4f5e-baf3-c613a4043e02 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:48.360253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724f28c-94fe-4f5e-baf3-c613a4043e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:48.369734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edc644-64d8-4e1e-b7a1-4bc44da282e3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:48.378294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7724f28c-94fe-4f5e-baf3-c613a4043e02 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:48.379546 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7724f28c-94fe-4f5e-baf3-c613a4043e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:48.408341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb75c7-2724-4715-ad47-7f53cea5689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:48.409003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb75c7-2724-4715-ad47-7f53cea5689b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:48.409319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb75c7-2724-4715-ad47-7f53cea5689b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:48.409599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb75c7-2724-4715-ad47-7f53cea5689b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:48.458188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 116/219] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:48.486754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724f28c-94fe-4f5e-baf3-c613a4043e02 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:48.504888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb75c7-2724-4715-ad47-7f53cea5689b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:48.506745 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb75c7-2724-4715-ad47-7f53cea5689b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:48.531044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:48.630258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724f28c-94fe-4f5e-baf3-c613a4043e02 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:48.631913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:48.639646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 104/220] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:48.641068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50110a76-49d6-40e7-92d2-aee26caa248a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:48.641385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50110a76-49d6-40e7-92d2-aee26caa248a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:48.641666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50110a76-49d6-40e7-92d2-aee26caa248a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:48.643282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 105/221] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:48.648036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50110a76-49d6-40e7-92d2-aee26caa248a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:48.679787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db9fa1-9446-4c1d-b0af-572849ca5375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:48.680604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db9fa1-9446-4c1d-b0af-572849ca5375 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:48.680886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db9fa1-9446-4c1d-b0af-572849ca5375 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:48.681573 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db9fa1-9446-4c1d-b0af-572849ca5375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:48.696407 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db9fa1-9446-4c1d-b0af-572849ca5375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e6db9fa1-9446-4c1d-b0af-572849ca5375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:48.706630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:48.707541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:48.708340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:48.713057 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 117/222] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:48.715552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13722af-88e6-45b1-bf4e-58d324a14eab None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:48.715854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13722af-88e6-45b1-bf4e-58d324a14eab None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:48.716171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13722af-88e6-45b1-bf4e-58d324a14eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:48.743069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d13722af-88e6-45b1-bf4e-58d324a14eab None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:48.744574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d13722af-88e6-45b1-bf4e-58d324a14eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:48.797828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50110a76-49d6-40e7-92d2-aee26caa248a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:48.817001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:48.837151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9aa8c-fd1d-4c1d-bc82-bbb103e1f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:48.838415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9aa8c-fd1d-4c1d-bc82-bbb103e1f75f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:48.838944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9aa8c-fd1d-4c1d-bc82-bbb103e1f75f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:48.839458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9aa8c-fd1d-4c1d-bc82-bbb103e1f75f None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:48.840900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9aa8c-fd1d-4c1d-bc82-bbb103e1f75f None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:48.842880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9aa8c-fd1d-4c1d-bc82-bbb103e1f75f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:48.844369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 118/223] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:48.845089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13722af-88e6-45b1-bf4e-58d324a14eab None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:48.845633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 106/224] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:48 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:48.851711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9aa8c-fd1d-4c1d-bc82-bbb103e1f75f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:48.971217 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:48.981819 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13722af-88e6-45b1-bf4e-58d324a14eab None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:48.983040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9aa8c-fd1d-4c1d-bc82-bbb103e1f75f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:49.020933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aaee85-5347-456c-9645-a860f5410890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:49.021992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaee85-5347-456c-9645-a860f5410890 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:49.022559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaee85-5347-456c-9645-a860f5410890 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:49.023126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaee85-5347-456c-9645-a860f5410890 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:49.024069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aaee85-5347-456c-9645-a860f5410890 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:49.024618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aaee85-5347-456c-9645-a860f5410890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:49.026332 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aaee85-5347-456c-9645-a860f5410890 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:49.028606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d327bad-8c13-48d9-8ed4-0248bbfb4e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:49.029727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327bad-8c13-48d9-8ed4-0248bbfb4e44 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:49.030015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327bad-8c13-48d9-8ed4-0248bbfb4e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:49.030296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327bad-8c13-48d9-8ed4-0248bbfb4e44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:49.031137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d327bad-8c13-48d9-8ed4-0248bbfb4e44 None admin] RBAC: Adding query filter params (role.id=2b2ea3ada01041ad941dd5b6721df5b2, scope.project.id=346276b0f40e4a0c84018861d282281c, user.id=33b31775859b40ef9eb3fea67e94fd11) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:49.031452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d327bad-8c13-48d9-8ed4-0248bbfb4e44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:49.032907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d327bad-8c13-48d9-8ed4-0248bbfb4e44 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:49.037194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 119/225] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:49.041322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 107/226] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:48 2022] GET /identity/v3/role_assignments?user.id=33b31775859b40ef9eb3fea67e94fd11&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:49.041322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d327bad-8c13-48d9-8ed4-0248bbfb4e44 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:49.051321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aaee85-5347-456c-9645-a860f5410890 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:49.118981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:49.217064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d327bad-8c13-48d9-8ed4-0248bbfb4e44 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:49.270563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aaee85-5347-456c-9645-a860f5410890 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:49.303395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0827d5-6707-41ec-ab00-0159efc97d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:49.304723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0827d5-6707-41ec-ab00-0159efc97d79 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:49.305232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0827d5-6707-41ec-ab00-0159efc97d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:49.305706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0827d5-6707-41ec-ab00-0159efc97d79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:49.319456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0827d5-6707-41ec-ab00-0159efc97d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:49.321420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883ee5-eb55-4c15-8a63-6c0f4a9df919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:49.322569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883ee5-eb55-4c15-8a63-6c0f4a9df919 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:49.323062 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883ee5-eb55-4c15-8a63-6c0f4a9df919 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:49.323567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883ee5-eb55-4c15-8a63-6c0f4a9df919 None admin] PATH_INFO: `/v3/users/c5c2339e4a0741d79dbb687afcece214` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:49.326144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43883ee5-eb55-4c15-8a63-6c0f4a9df919 None admin] RBAC: Authorizing `identity:get_user(user_id=c5c2339e4a0741d79dbb687afcece214)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:49.328199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43883ee5-eb55-4c15-8a63-6c0f4a9df919 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1c0827d5-6707-41ec-ab00-0159efc97d79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:49.329881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:49.330735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:49.331522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 108/227] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:58:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:49.332871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 120/228] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:49 2022] GET /identity/v3/users/c5c2339e4a0741d79dbb687afcece214 => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:49.338738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0827d5-6707-41ec-ab00-0159efc97d79 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:49.350957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883ee5-eb55-4c15-8a63-6c0f4a9df919 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:49.422689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:49.479147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0827d5-6707-41ec-ab00-0159efc97d79 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:49.509544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:49.526362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883ee5-eb55-4c15-8a63-6c0f4a9df919 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:49.559835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363358f9-0aaf-4482-9c2a-27b2c70091cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:49.560527 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363358f9-0aaf-4482-9c2a-27b2c70091cc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:49.560801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363358f9-0aaf-4482-9c2a-27b2c70091cc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:49.561087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363358f9-0aaf-4482-9c2a-27b2c70091cc None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:49.561898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363358f9-0aaf-4482-9c2a-27b2c70091cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:49.562207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363358f9-0aaf-4482-9c2a-27b2c70091cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:49.563637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363358f9-0aaf-4482-9c2a-27b2c70091cc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:49.574837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479a76e-ea09-4284-a236-5364c64ba2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:49.578169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479a76e-ea09-4284-a236-5364c64ba2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:49.578661 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479a76e-ea09-4284-a236-5364c64ba2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:49.579149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479a76e-ea09-4284-a236-5364c64ba2e3 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:49.581961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479a76e-ea09-4284-a236-5364c64ba2e3 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:49.584833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 109/229] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:58:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:49.586557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479a76e-ea09-4284-a236-5364c64ba2e3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:49.588851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 121/230] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:49 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:49.590320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363358f9-0aaf-4482-9c2a-27b2c70091cc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:49.595133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479a76e-ea09-4284-a236-5364c64ba2e3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:49.726261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363358f9-0aaf-4482-9c2a-27b2c70091cc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:49.762758 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef78c-b94f-4a77-a4e4-025d6688292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:49.764010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef78c-b94f-4a77-a4e4-025d6688292b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:49.764506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef78c-b94f-4a77-a4e4-025d6688292b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:49.764977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef78c-b94f-4a77-a4e4-025d6688292b None admin] PATH_INFO: `/v3/users/c5c2339e4a0741d79dbb687afcece214` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:49.766475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef78c-b94f-4a77-a4e4-025d6688292b None admin] RBAC: Authorizing `identity:get_user(user_id=c5c2339e4a0741d79dbb687afcece214)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:49.768234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef78c-b94f-4a77-a4e4-025d6688292b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:49.770554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 110/231] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:49 2022] GET /identity/v3/users/c5c2339e4a0741d79dbb687afcece214 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:49.776144 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef78c-b94f-4a77-a4e4-025d6688292b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:49.829695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:49.846981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:49.883423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479a76e-ea09-4284-a236-5364c64ba2e3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:49.896911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef78c-b94f-4a77-a4e4-025d6688292b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:49.936187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f6ba-7a75-4020-9eeb-80b537477be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:49.937537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f6ba-7a75-4020-9eeb-80b537477be3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:49.938023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f6ba-7a75-4020-9eeb-80b537477be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:49.938497 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f6ba-7a75-4020-9eeb-80b537477be3 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:49.940012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901f6ba-7a75-4020-9eeb-80b537477be3 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:49.941758 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901f6ba-7a75-4020-9eeb-80b537477be3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:49.943791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 111/232] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:49 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:49.949927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f6ba-7a75-4020-9eeb-80b537477be3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:49.977540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543399b-66a4-4baf-9feb-823dd8d4f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:49.978474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543399b-66a4-4baf-9feb-823dd8d4f12d None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:49.978789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543399b-66a4-4baf-9feb-823dd8d4f12d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:49.979023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543399b-66a4-4baf-9feb-823dd8d4f12d None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c/users/c5c2339e4a0741d79dbb687afcece214/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:49.983715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543399b-66a4-4baf-9feb-823dd8d4f12d None admin] RBAC: Authorizing `identity:create_grant(project_id=346276b0f40e4a0c84018861d282281c, user_id=c5c2339e4a0741d79dbb687afcece214, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:49.985233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543399b-66a4-4baf-9feb-823dd8d4f12d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:50.013590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 122/233] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:58:49 2022] PUT /identity/v3/projects/346276b0f40e4a0c84018861d282281c/users/c5c2339e4a0741d79dbb687afcece214/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 14:58:50.124402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f6ba-7a75-4020-9eeb-80b537477be3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:50.136134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:50.182144 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedef1af-7e47-4726-8be2-e3a2aa162f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:50.183227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedef1af-7e47-4726-8be2-e3a2aa162f10 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:50.183604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedef1af-7e47-4726-8be2-e3a2aa162f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:50.183897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedef1af-7e47-4726-8be2-e3a2aa162f10 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c/users/c5c2339e4a0741d79dbb687afcece214/roles/f36f89c30b0a4c38900202ea156ed20e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:50.191982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedef1af-7e47-4726-8be2-e3a2aa162f10 None admin] RBAC: Authorizing `identity:create_grant(project_id=346276b0f40e4a0c84018861d282281c, user_id=c5c2339e4a0741d79dbb687afcece214, role_id=f36f89c30b0a4c38900202ea156ed20e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:50.194676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedef1af-7e47-4726-8be2-e3a2aa162f10 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:50.211456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 112/234] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:58:49 2022] PUT /identity/v3/projects/346276b0f40e4a0c84018861d282281c/users/c5c2339e4a0741d79dbb687afcece214/roles/f36f89c30b0a4c38900202ea156ed20e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:58:50.756592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72e06-b5e9-4a43-93e5-3d3e1749e1bd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:50.757017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72e06-b5e9-4a43-93e5-3d3e1749e1bd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:50.757192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72e06-b5e9-4a43-93e5-3d3e1749e1bd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:50.758578 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 123/235] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:50.766678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84c484-eed1-4a2b-8333-81c768078692 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:50.767184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84c484-eed1-4a2b-8333-81c768078692 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:50.767684 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84c484-eed1-4a2b-8333-81c768078692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:50.802960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4d84c484-eed1-4a2b-8333-81c768078692 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:50.804542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4d84c484-eed1-4a2b-8333-81c768078692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:50.936178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 113/236] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:50.978870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72e06-b5e9-4a43-93e5-3d3e1749e1bd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:51.129752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72e06-b5e9-4a43-93e5-3d3e1749e1bd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:51.185966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e652-5a32-4ada-b0eb-61d9f9a4bef1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:51.186307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e652-5a32-4ada-b0eb-61d9f9a4bef1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:51.186531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e652-5a32-4ada-b0eb-61d9f9a4bef1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:51.187925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 114/237] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:58:51.197172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfbbd1-80d4-45ce-ba79-4b028d3170de None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:51.197482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfbbd1-80d4-45ce-ba79-4b028d3170de None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:51.197753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfbbd1-80d4-45ce-ba79-4b028d3170de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:51.204865 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957326d3-e313-44fa-9813-fd8935e7d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:51.206800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957326d3-e313-44fa-9813-fd8935e7d2eb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:51.207098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957326d3-e313-44fa-9813-fd8935e7d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:51.207372 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957326d3-e313-44fa-9813-fd8935e7d2eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:51.214342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957326d3-e313-44fa-9813-fd8935e7d2eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:51.216434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957326d3-e313-44fa-9813-fd8935e7d2eb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:51.219197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 124/238] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:51.226696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957326d3-e313-44fa-9813-fd8935e7d2eb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:51.231802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-16dfbbd1-80d4-45ce-ba79-4b028d3170de None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:51.233489 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-16dfbbd1-80d4-45ce-ba79-4b028d3170de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:51.274862 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:51.411617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957326d3-e313-44fa-9813-fd8935e7d2eb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:51.445077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 115/239] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:51.458045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fa1eb-1c11-452b-b3e3-3f1c38d3993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:51.458846 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fa1eb-1c11-452b-b3e3-3f1c38d3993e None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:51.459126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fa1eb-1c11-452b-b3e3-3f1c38d3993e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:51.459396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fa1eb-1c11-452b-b3e3-3f1c38d3993e None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:51.460117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fa1eb-1c11-452b-b3e3-3f1c38d3993e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:51.461915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fa1eb-1c11-452b-b3e3-3f1c38d3993e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:51.487404 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfbbd1-80d4-45ce-ba79-4b028d3170de None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:51.497254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 125/240] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:58:51 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:51.555474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:51.614419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571023-dd5f-492e-80d5-62a2f066f06c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:51.614787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571023-dd5f-492e-80d5-62a2f066f06c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:51.615115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571023-dd5f-492e-80d5-62a2f066f06c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:51.617196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 126/241] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:51.623842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb41333-5ceb-45e4-bfa6-f179f730a0ca None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:51.624132 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb41333-5ceb-45e4-bfa6-f179f730a0ca None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:51.624387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb41333-5ceb-45e4-bfa6-f179f730a0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:51.652363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ccb41333-5ceb-45e4-bfa6-f179f730a0ca None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:51.654761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ccb41333-5ceb-45e4-bfa6-f179f730a0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:51.737384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfbbd1-80d4-45ce-ba79-4b028d3170de None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:51.785236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 127/242] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:51.802041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bf25b-e93b-4d95-a520-592eb06cfe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:51.802874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bf25b-e93b-4d95-a520-592eb06cfe33 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:51.803161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bf25b-e93b-4d95-a520-592eb06cfe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:51.803626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bf25b-e93b-4d95-a520-592eb06cfe33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:51.812885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb41333-5ceb-45e4-bfa6-f179f730a0ca None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:51.820765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:51.825012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bf25b-e93b-4d95-a520-592eb06cfe33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ff3bf25b-e93b-4d95-a520-592eb06cfe33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:51.836330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:51.837306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:58:51.838073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:51.840704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 116/243] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:58:51.847318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bf25b-e93b-4d95-a520-592eb06cfe33 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:51.961553 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb41333-5ceb-45e4-bfa6-f179f730a0ca None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:51.973796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:52.000035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bf25b-e93b-4d95-a520-592eb06cfe33 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:52.012115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f816a1-8f05-45eb-896a-df7e38003776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:52.013036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f816a1-8f05-45eb-896a-df7e38003776 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:52.013417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f816a1-8f05-45eb-896a-df7e38003776 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:52.013776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f816a1-8f05-45eb-896a-df7e38003776 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:52.031024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f816a1-8f05-45eb-896a-df7e38003776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-34f816a1-8f05-45eb-896a-df7e38003776 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:52.041789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:52.042836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:52.043603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:52.046246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 128/244] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:52.051914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efef35-51c1-4ab3-bd85-d946417dbf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:52.052628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efef35-51c1-4ab3-bd85-d946417dbf35 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:52.052986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efef35-51c1-4ab3-bd85-d946417dbf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:52.053169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efef35-51c1-4ab3-bd85-d946417dbf35 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:52.053990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efef35-51c1-4ab3-bd85-d946417dbf35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:52.054302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efef35-51c1-4ab3-bd85-d946417dbf35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:52.055729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efef35-51c1-4ab3-bd85-d946417dbf35 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:52.061614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f816a1-8f05-45eb-896a-df7e38003776 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:52.068509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 117/245] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:52.074257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efef35-51c1-4ab3-bd85-d946417dbf35 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:52.147431 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:52.196330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f816a1-8f05-45eb-896a-df7e38003776 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:52.215089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efef35-51c1-4ab3-bd85-d946417dbf35 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:52.243116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456abc9-1649-415e-b418-a35dbe32a84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:52.243837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456abc9-1649-415e-b418-a35dbe32a84d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:52.244119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456abc9-1649-415e-b418-a35dbe32a84d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:52.244973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456abc9-1649-415e-b418-a35dbe32a84d None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:52.245880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456abc9-1649-415e-b418-a35dbe32a84d None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:52.246337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456abc9-1649-415e-b418-a35dbe32a84d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:52.249069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456abc9-1649-415e-b418-a35dbe32a84d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:52.260296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 129/246] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:52.265927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456abc9-1649-415e-b418-a35dbe32a84d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:52.268612 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eae794-ca18-47df-8689-34bf16d5e504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:52.270226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae794-ca18-47df-8689-34bf16d5e504 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:52.270772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae794-ca18-47df-8689-34bf16d5e504 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:52.271283 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae794-ca18-47df-8689-34bf16d5e504 None admin] PATH_INFO: `/v3/users/c8a7ceaa79764e3b95dedda84b1a1436` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:52.297274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eae794-ca18-47df-8689-34bf16d5e504 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a7ceaa79764e3b95dedda84b1a1436)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:52.299183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eae794-ca18-47df-8689-34bf16d5e504 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:52.301864 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 118/247] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:52 2022] GET /identity/v3/users/c8a7ceaa79764e3b95dedda84b1a1436 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:52.310977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eae794-ca18-47df-8689-34bf16d5e504 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:52.324856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:52.414237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456abc9-1649-415e-b418-a35dbe32a84d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:52.439114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eae794-ca18-47df-8689-34bf16d5e504 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:52.445116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:52.465776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75048c1d-6db6-4603-aee4-fa3c650ec9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:52.467038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048c1d-6db6-4603-aee4-fa3c650ec9ae None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:52.467570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048c1d-6db6-4603-aee4-fa3c650ec9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:52.468136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048c1d-6db6-4603-aee4-fa3c650ec9ae None admin] PATH_INFO: `/v3/users/33b31775859b40ef9eb3fea67e94fd11` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:52.469640 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75048c1d-6db6-4603-aee4-fa3c650ec9ae None admin] RBAC: Authorizing `identity:get_user(user_id=33b31775859b40ef9eb3fea67e94fd11)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:52.471596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75048c1d-6db6-4603-aee4-fa3c650ec9ae None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:52.478927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 130/248] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:52 2022] GET /identity/v3/users/33b31775859b40ef9eb3fea67e94fd11 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:52.479571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c54f1-0035-4b95-8b77-6280257cc115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:52.480669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c54f1-0035-4b95-8b77-6280257cc115 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:52.480669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c54f1-0035-4b95-8b77-6280257cc115 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:52.480951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c54f1-0035-4b95-8b77-6280257cc115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:52.483541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75048c1d-6db6-4603-aee4-fa3c650ec9ae None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:52.595857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c54f1-0035-4b95-8b77-6280257cc115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:52.597302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c54f1-0035-4b95-8b77-6280257cc115 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:52.606068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:52.694164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75048c1d-6db6-4603-aee4-fa3c650ec9ae None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:52.775252 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a459c35-f12f-4784-b9a4-45148a90f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:52.776146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a459c35-f12f-4784-b9a4-45148a90f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:52.776438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a459c35-f12f-4784-b9a4-45148a90f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:52.777809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a459c35-f12f-4784-b9a4-45148a90f1f1 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:52.785231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a459c35-f12f-4784-b9a4-45148a90f1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:52.785231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a459c35-f12f-4784-b9a4-45148a90f1f1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:52.786127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 131/249] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:52 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:52.797963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a459c35-f12f-4784-b9a4-45148a90f1f1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:52.812840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 119/250] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:52.822067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c54f1-0035-4b95-8b77-6280257cc115 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:52.881662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:52.919636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a459c35-f12f-4784-b9a4-45148a90f1f1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:52.983845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52f842-6d9f-41d8-96c6-b31eba0fc86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:52.984773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f842-6d9f-41d8-96c6-b31eba0fc86e None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:52.985051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f842-6d9f-41d8-96c6-b31eba0fc86e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:52.985349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f842-6d9f-41d8-96c6-b31eba0fc86e None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c/users/33b31775859b40ef9eb3fea67e94fd11/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:52.991814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52f842-6d9f-41d8-96c6-b31eba0fc86e None admin] RBAC: Authorizing `identity:create_grant(project_id=346276b0f40e4a0c84018861d282281c, user_id=33b31775859b40ef9eb3fea67e94fd11, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:52.993343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52f842-6d9f-41d8-96c6-b31eba0fc86e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:53.028891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 132/251] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:58:52 2022] PUT /identity/v3/projects/346276b0f40e4a0c84018861d282281c/users/33b31775859b40ef9eb3fea67e94fd11/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:58:53.055945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c54f1-0035-4b95-8b77-6280257cc115 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:53.073645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:53.101871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cc59e-6058-4629-9b61-8e81ae2a1ae0 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:53.102225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cc59e-6058-4629-9b61-8e81ae2a1ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:53.102572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cc59e-6058-4629-9b61-8e81ae2a1ae0 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:53.104499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 133/252] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:58:53.111536 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2f97-5c49-44be-b811-6c89c9944f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:53.111877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d8c3-0f2b-4fb3-8fc3-9a2313635f80 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:53.112173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d8c3-0f2b-4fb3-8fc3-9a2313635f80 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:53.112454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d8c3-0f2b-4fb3-8fc3-9a2313635f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:53.113331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2f97-5c49-44be-b811-6c89c9944f82 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:53.113782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2f97-5c49-44be-b811-6c89c9944f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:53.114233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2f97-5c49-44be-b811-6c89c9944f82 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:53.115667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca2f97-5c49-44be-b811-6c89c9944f82 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:53.117421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca2f97-5c49-44be-b811-6c89c9944f82 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:53.119786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 120/253] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:52 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:53.126598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2f97-5c49-44be-b811-6c89c9944f82 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:53.139344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8559d8c3-0f2b-4fb3-8fc3-9a2313635f80 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:53.140590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8559d8c3-0f2b-4fb3-8fc3-9a2313635f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:53.269536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 134/254] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:53.271207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24300ee-8a9c-4e8c-8bc0-d4184dcb7227 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:53.271507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24300ee-8a9c-4e8c-8bc0-d4184dcb7227 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:53.271785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24300ee-8a9c-4e8c-8bc0-d4184dcb7227 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:53.273677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 135/255] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:53.280237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8924-0fa8-4993-8152-3dc05a3ad7d1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:53.280519 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8924-0fa8-4993-8152-3dc05a3ad7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:53.280806 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8924-0fa8-4993-8152-3dc05a3ad7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:53.311070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-38ee8924-0fa8-4993-8152-3dc05a3ad7d1 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:53.312746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-38ee8924-0fa8-4993-8152-3dc05a3ad7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:53.373748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2f97-5c49-44be-b811-6c89c9944f82 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:53.386432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:53.413394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 136/256] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:53.414701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee8924-0fa8-4993-8152-3dc05a3ad7d1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:53.418901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b70755-b571-416d-af62-44bde5e9924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:53.419574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b70755-b571-416d-af62-44bde5e9924b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:53.419849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b70755-b571-416d-af62-44bde5e9924b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:53.420118 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b70755-b571-416d-af62-44bde5e9924b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:53.420955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b70755-b571-416d-af62-44bde5e9924b None admin] RBAC: Adding query filter params (role.id=16a382e27714463d91383877be17fa0a, scope.project.id=346276b0f40e4a0c84018861d282281c, user.id=c8a7ceaa79764e3b95dedda84b1a1436) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:53.421292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b70755-b571-416d-af62-44bde5e9924b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:53.422823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b70755-b571-416d-af62-44bde5e9924b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:53.430368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 121/257] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:53 2022] GET /identity/v3/role_assignments?user.id=c8a7ceaa79764e3b95dedda84b1a1436&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=16a382e27714463d91383877be17fa0a => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:53.467223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b70755-b571-416d-af62-44bde5e9924b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:53.555201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee8924-0fa8-4993-8152-3dc05a3ad7d1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:53.564535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:53.688590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9a70-d595-46d5-9160-ca2f6a165dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:53.689877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9a70-d595-46d5-9160-ca2f6a165dcf None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:53.690356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9a70-d595-46d5-9160-ca2f6a165dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:53.690801 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9a70-d595-46d5-9160-ca2f6a165dcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:53.731778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec9a70-d595-46d5-9160-ca2f6a165dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-00ec9a70-d595-46d5-9160-ca2f6a165dcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:53.740030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:53.740886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:53.741666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 137/258] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:58:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:53.763609 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9a70-d595-46d5-9160-ca2f6a165dcf None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:53.768207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b70755-b571-416d-af62-44bde5e9924b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:53.854338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:53.855947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3b00d-22cb-461b-8dad-d2c62d1638df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:53.857966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b00d-22cb-461b-8dad-d2c62d1638df None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:53.857966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b00d-22cb-461b-8dad-d2c62d1638df None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:53.857966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b00d-22cb-461b-8dad-d2c62d1638df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:53.896397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3b00d-22cb-461b-8dad-d2c62d1638df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a5f3b00d-22cb-461b-8dad-d2c62d1638df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:53.913110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:53.914070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:58:53.914857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:53.925229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 122/259] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:58:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:53.927046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3b00d-22cb-461b-8dad-d2c62d1638df None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:54.019107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9a70-d595-46d5-9160-ca2f6a165dcf None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:54.115395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1a27c-048d-4c10-9330-405f77a836cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:54.116077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1a27c-048d-4c10-9330-405f77a836cb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:54.116331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1a27c-048d-4c10-9330-405f77a836cb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:54.116601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1a27c-048d-4c10-9330-405f77a836cb None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:54.117399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1a27c-048d-4c10-9330-405f77a836cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:54.117707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1a27c-048d-4c10-9330-405f77a836cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:54.119111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1a27c-048d-4c10-9330-405f77a836cb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:54.141978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 138/260] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:58:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:54.155998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1a27c-048d-4c10-9330-405f77a836cb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:54.174591 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3b00d-22cb-461b-8dad-d2c62d1638df None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:54.183523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:54.297854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d111f41-6598-430f-86ee-2c8d19607831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:54.298968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d111f41-6598-430f-86ee-2c8d19607831 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:54.299255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d111f41-6598-430f-86ee-2c8d19607831 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:54.299536 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d111f41-6598-430f-86ee-2c8d19607831 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:54.300303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d111f41-6598-430f-86ee-2c8d19607831 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:54.300613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d111f41-6598-430f-86ee-2c8d19607831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:54.302235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d111f41-6598-430f-86ee-2c8d19607831 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:54.328928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 123/261] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:54.334842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d111f41-6598-430f-86ee-2c8d19607831 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:54.422302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1a27c-048d-4c10-9330-405f77a836cb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:54.426107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:54.489306 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da0656-e61b-428b-88be-c631c380139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:54.490206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da0656-e61b-428b-88be-c631c380139a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:54.490490 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da0656-e61b-428b-88be-c631c380139a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:54.490771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da0656-e61b-428b-88be-c631c380139a None admin] PATH_INFO: `/v3/users/c5c2339e4a0741d79dbb687afcece214` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:54.491997 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da0656-e61b-428b-88be-c631c380139a None admin] RBAC: Authorizing `identity:get_user(user_id=c5c2339e4a0741d79dbb687afcece214)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:54.493668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da0656-e61b-428b-88be-c631c380139a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:54.495837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 139/262] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:54 2022] GET /identity/v3/users/c5c2339e4a0741d79dbb687afcece214 => generated 283 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:54.502867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da0656-e61b-428b-88be-c631c380139a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:54.507409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d111f41-6598-430f-86ee-2c8d19607831 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:54.575661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d126d5b-0fac-439b-bae3-777d64978ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:54.576825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d126d5b-0fac-439b-bae3-777d64978ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:54.577103 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d126d5b-0fac-439b-bae3-777d64978ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:54.577405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d126d5b-0fac-439b-bae3-777d64978ac9 None admin] PATH_INFO: `/v3/users/c5c2339e4a0741d79dbb687afcece214` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:54.578652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d126d5b-0fac-439b-bae3-777d64978ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=c5c2339e4a0741d79dbb687afcece214)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:54.580871 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d126d5b-0fac-439b-bae3-777d64978ac9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:54.582991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 124/263] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:54 2022] GET /identity/v3/users/c5c2339e4a0741d79dbb687afcece214 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:54.590715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d126d5b-0fac-439b-bae3-777d64978ac9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:54.647312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:54.719191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da0656-e61b-428b-88be-c631c380139a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:54.774328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d126d5b-0fac-439b-bae3-777d64978ac9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:54.783649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3c652-188a-475a-ba65-675306dcd1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:54.784624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c652-188a-475a-ba65-675306dcd1cb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:54.785101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c652-188a-475a-ba65-675306dcd1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:54.785607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c652-188a-475a-ba65-675306dcd1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:54.863742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:54.866193 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d729f9-3cef-4ea8-8e62-87952e908c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:54.867597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d729f9-3cef-4ea8-8e62-87952e908c0f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:54.867882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d729f9-3cef-4ea8-8e62-87952e908c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:54.868156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d729f9-3cef-4ea8-8e62-87952e908c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:54.921518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3c652-188a-475a-ba65-675306dcd1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:54.923148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3c652-188a-475a-ba65-675306dcd1cb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:55.011985 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d729f9-3cef-4ea8-8e62-87952e908c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:55.013590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d729f9-3cef-4ea8-8e62-87952e908c0f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:55.101635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:55.146380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 140/264] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 14:58:55.148537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c07b5-8e1d-4765-9ab0-449523d59734 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:55.149050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c07b5-8e1d-4765-9ab0-449523d59734 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:55.149545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c07b5-8e1d-4765-9ab0-449523d59734 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:55.151254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 141/265] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:55.152381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c07b5-8e1d-4765-9ab0-449523d59734 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:55.230098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 125/266] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:55.231763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf4145-059f-4fc1-bf50-fabacb15fe55 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:55.232052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf4145-059f-4fc1-bf50-fabacb15fe55 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:55.232331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf4145-059f-4fc1-bf50-fabacb15fe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:55.290280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7acf4145-059f-4fc1-bf50-fabacb15fe55 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:55.291475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7acf4145-059f-4fc1-bf50-fabacb15fe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:55.306759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:55.375506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c07b5-8e1d-4765-9ab0-449523d59734 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:55.416598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 126/267] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:55.422189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf4145-059f-4fc1-bf50-fabacb15fe55 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:55.456644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1e09e-1166-4b1a-9abe-4fda26b37a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:55.457621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1e09e-1166-4b1a-9abe-4fda26b37a09 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:55.457898 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1e09e-1166-4b1a-9abe-4fda26b37a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:55.458374 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1e09e-1166-4b1a-9abe-4fda26b37a09 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:55.459750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1e09e-1166-4b1a-9abe-4fda26b37a09 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:55.461341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1e09e-1166-4b1a-9abe-4fda26b37a09 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:55.463831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 142/268] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:55 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:55.470186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1e09e-1166-4b1a-9abe-4fda26b37a09 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:55.580516 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:55.640242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1e09e-1166-4b1a-9abe-4fda26b37a09 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:55.674886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf4145-059f-4fc1-bf50-fabacb15fe55 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:55.687537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acff0da-4544-41b2-906f-9a789d230da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:55.688359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acff0da-4544-41b2-906f-9a789d230da2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:55.688638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acff0da-4544-41b2-906f-9a789d230da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:55.688912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acff0da-4544-41b2-906f-9a789d230da2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:55.698072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:55.702785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acff0da-4544-41b2-906f-9a789d230da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9acff0da-4544-41b2-906f-9a789d230da2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:55.711009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:55.711934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:55.712705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 143/269] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:55.713359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acff0da-4544-41b2-906f-9a789d230da2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:55.731968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b92da-800d-4bf1-b1c9-d5b609ac945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:55.733299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b92da-800d-4bf1-b1c9-d5b609ac945b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:55.733687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b92da-800d-4bf1-b1c9-d5b609ac945b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:55.733968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b92da-800d-4bf1-b1c9-d5b609ac945b None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:55.736213 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b92da-800d-4bf1-b1c9-d5b609ac945b None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:55.738266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b92da-800d-4bf1-b1c9-d5b609ac945b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:55.745327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 127/270] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:55 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:55.746959 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f3a6-1dc9-4aad-be18-0abd7c812da5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:55.747245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f3a6-1dc9-4aad-be18-0abd7c812da5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:55.747519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f3a6-1dc9-4aad-be18-0abd7c812da5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:55.750011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 128/271] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:55.750574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40f3a6-1dc9-4aad-be18-0abd7c812da5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:55.844775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acff0da-4544-41b2-906f-9a789d230da2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:55.871293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40f3a6-1dc9-4aad-be18-0abd7c812da5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:55.882242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfff701-e555-4488-ba7c-c18598eea097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:55.883474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfff701-e555-4488-ba7c-c18598eea097 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:55.883936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfff701-e555-4488-ba7c-c18598eea097 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:55.884375 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfff701-e555-4488-ba7c-c18598eea097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:55.885654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfff701-e555-4488-ba7c-c18598eea097 None admin] RBAC: Adding query filter params (role.id=f36f89c30b0a4c38900202ea156ed20e, scope.project.id=346276b0f40e4a0c84018861d282281c, user.id=c5c2339e4a0741d79dbb687afcece214) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:55.886227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfff701-e555-4488-ba7c-c18598eea097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:55.888034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfff701-e555-4488-ba7c-c18598eea097 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:55.899808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 144/272] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:55 2022] GET /identity/v3/role_assignments?user.id=c5c2339e4a0741d79dbb687afcece214&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=f36f89c30b0a4c38900202ea156ed20e => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:55.901079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfff701-e555-4488-ba7c-c18598eea097 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:55.905248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:55.909888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262edae5-1b75-4878-9348-47d916df0f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:55.913579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edae5-1b75-4878-9348-47d916df0f2c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:55.913579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edae5-1b75-4878-9348-47d916df0f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:55.913579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edae5-1b75-4878-9348-47d916df0f2c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:55.913579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262edae5-1b75-4878-9348-47d916df0f2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:55.913579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262edae5-1b75-4878-9348-47d916df0f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:55.914024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262edae5-1b75-4878-9348-47d916df0f2c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:55.924842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 129/273] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:55.926111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1713-5caa-446b-9707-db3fca35cec3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:55.926343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1713-5caa-446b-9707-db3fca35cec3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:55.926621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1713-5caa-446b-9707-db3fca35cec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:55.945153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2bab1713-5caa-446b-9707-db3fca35cec3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:55.946541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2bab1713-5caa-446b-9707-db3fca35cec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:56.035302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 130/274] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:56.035983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1713-5caa-446b-9707-db3fca35cec3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:56.055966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:56.144076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfff701-e555-4488-ba7c-c18598eea097 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:56.203584 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833546c5-644b-46a1-979e-fde127d18b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:56.204190 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833546c5-644b-46a1-979e-fde127d18b56 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.204400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833546c5-644b-46a1-979e-fde127d18b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.204834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833546c5-644b-46a1-979e-fde127d18b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.205627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1713-5caa-446b-9707-db3fca35cec3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:56.206166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833546c5-644b-46a1-979e-fde127d18b56 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=346276b0f40e4a0c84018861d282281c, user.id=c5c2339e4a0741d79dbb687afcece214) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:56.206668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833546c5-644b-46a1-979e-fde127d18b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:56.208353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833546c5-644b-46a1-979e-fde127d18b56 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:56.215689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 145/275] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:55 2022] GET /identity/v3/role_assignments?user.id=c5c2339e4a0741d79dbb687afcece214&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=8a6fe5045159487aa0119348cfe94387 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:56.216862 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833546c5-644b-46a1-979e-fde127d18b56 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:56.239066 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:56.244640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d832e7e-96d4-4b39-a0a1-dc4b69f8850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:56.245617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832e7e-96d4-4b39-a0a1-dc4b69f8850c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.245902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832e7e-96d4-4b39-a0a1-dc4b69f8850c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.246247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832e7e-96d4-4b39-a0a1-dc4b69f8850c None admin] PATH_INFO: `/v3/users/174cd8c064f44441a6ad4c56b5c829b9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.262643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d832e7e-96d4-4b39-a0a1-dc4b69f8850c None admin] RBAC: Authorizing `identity:get_user(user_id=174cd8c064f44441a6ad4c56b5c829b9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:56.264611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d832e7e-96d4-4b39-a0a1-dc4b69f8850c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:56.266975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 131/276] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:56 2022] GET /identity/v3/users/174cd8c064f44441a6ad4c56b5c829b9 => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:56.269713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73eb9f-487f-43b9-bd38-87abc61e0349 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.270260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73eb9f-487f-43b9-bd38-87abc61e0349 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.270713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73eb9f-487f-43b9-bd38-87abc61e0349 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.272367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 132/277] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:56.278361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73eb9f-487f-43b9-bd38-87abc61e0349 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:56.357826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833546c5-644b-46a1-979e-fde127d18b56 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:56.394918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:56.408207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab92995-6349-4fac-a41d-9b96939d816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:56.409385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab92995-6349-4fac-a41d-9b96939d816e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.409830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab92995-6349-4fac-a41d-9b96939d816e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.410941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab92995-6349-4fac-a41d-9b96939d816e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.412473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab92995-6349-4fac-a41d-9b96939d816e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:56.414415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab92995-6349-4fac-a41d-9b96939d816e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:56.416260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 146/278] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:56.417724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503da8c-88e8-4d79-9534-60e16ef3e9b3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.418175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503da8c-88e8-4d79-9534-60e16ef3e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.418575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503da8c-88e8-4d79-9534-60e16ef3e9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.439206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1503da8c-88e8-4d79-9534-60e16ef3e9b3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:56.440417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1503da8c-88e8-4d79-9534-60e16ef3e9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:56.449496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73eb9f-487f-43b9-bd38-87abc61e0349 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:56.497028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875545b-8e3f-45eb-ae24-976c4779b0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:56.498030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875545b-8e3f-45eb-ae24-976c4779b0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.498315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875545b-8e3f-45eb-ae24-976c4779b0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.498727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875545b-8e3f-45eb-ae24-976c4779b0e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.499891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875545b-8e3f-45eb-ae24-976c4779b0e9 None admin] RBAC: Adding query filter params (role.id=2b2ea3ada01041ad941dd5b6721df5b2, user.id=174cd8c064f44441a6ad4c56b5c829b9, scope.system=all) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:56.500212 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875545b-8e3f-45eb-ae24-976c4779b0e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:56.501739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875545b-8e3f-45eb-ae24-976c4779b0e9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:56.509035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 133/279] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Jun 17 14:58:56 2022] GET /identity/v3/role_assignments?user.id=174cd8c064f44441a6ad4c56b5c829b9&scope.system=all&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:56.510415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede4487-f3bd-4830-bc9b-e188b2dc9ce8 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.510705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede4487-f3bd-4830-bc9b-e188b2dc9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.511457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede4487-f3bd-4830-bc9b-e188b2dc9ce8 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.512946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 134/280] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:56.518608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 147/281] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:56.518797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede4487-f3bd-4830-bc9b-e188b2dc9ce8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:56.523731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493da54-a45a-44d5-a56c-29774e5fb465 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.523731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493da54-a45a-44d5-a56c-29774e5fb465 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.523731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493da54-a45a-44d5-a56c-29774e5fb465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.544399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2493da54-a45a-44d5-a56c-29774e5fb465 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:56.546223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2493da54-a45a-44d5-a56c-29774e5fb465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:56.585887 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:56.639590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 148/282] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:56.639590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493da54-a45a-44d5-a56c-29774e5fb465 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:56.673138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede4487-f3bd-4830-bc9b-e188b2dc9ce8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:56.705981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:56.713726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d844978-dead-46c5-ba83-89659bd7165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:56.714480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844978-dead-46c5-ba83-89659bd7165e None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.714765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844978-dead-46c5-ba83-89659bd7165e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.715048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844978-dead-46c5-ba83-89659bd7165e None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.715801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d844978-dead-46c5-ba83-89659bd7165e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:56.717290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d844978-dead-46c5-ba83-89659bd7165e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:56.740026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 135/283] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:58:56 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:58:56.740674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d844978-dead-46c5-ba83-89659bd7165e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:56.757597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493da54-a45a-44d5-a56c-29774e5fb465 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:56.831492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802b00f-5ab4-4065-ba2e-377031d153ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:56.832321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802b00f-5ab4-4065-ba2e-377031d153ae None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.832599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802b00f-5ab4-4065-ba2e-377031d153ae None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.832876 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802b00f-5ab4-4065-ba2e-377031d153ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.848864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802b00f-5ab4-4065-ba2e-377031d153ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f802b00f-5ab4-4065-ba2e-377031d153ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:56.858597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:56.860310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:56.862533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:56.865139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 149/284] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:56.866322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802b00f-5ab4-4065-ba2e-377031d153ae None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:56.910700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:56.920781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d844978-dead-46c5-ba83-89659bd7165e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:56.977317 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1c486-e478-460e-88e1-7cf81aedcac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:56.978768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c486-e478-460e-88e1-7cf81aedcac9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:56.979264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c486-e478-460e-88e1-7cf81aedcac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:56.979883 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c486-e478-460e-88e1-7cf81aedcac9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:56.994319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1c486-e478-460e-88e1-7cf81aedcac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1ea1c486-e478-460e-88e1-7cf81aedcac9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:57.003532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:57.004482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:58:57.005274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:58:57.005862 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802b00f-5ab4-4065-ba2e-377031d153ae None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:57.007364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 136/285] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:57.020250 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1c486-e478-460e-88e1-7cf81aedcac9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:57.026354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:57.057364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b1403-1b46-4f68-870c-dd131c3c93f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:57.058216 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b1403-1b46-4f68-870c-dd131c3c93f9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:57.058597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b1403-1b46-4f68-870c-dd131c3c93f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:57.060072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b1403-1b46-4f68-870c-dd131c3c93f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:57.061276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b1403-1b46-4f68-870c-dd131c3c93f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:57.061689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b1403-1b46-4f68-870c-dd131c3c93f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:57.063384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b1403-1b46-4f68-870c-dd131c3c93f9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:57.075073 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 150/286] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:57.080774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b1403-1b46-4f68-870c-dd131c3c93f9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:57.163758 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1c486-e478-460e-88e1-7cf81aedcac9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:57.206862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d92758-63b8-4bc7-b518-93bacce38a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:57.207564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d92758-63b8-4bc7-b518-93bacce38a12 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:57.207845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d92758-63b8-4bc7-b518-93bacce38a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:57.208124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d92758-63b8-4bc7-b518-93bacce38a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:57.208886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d92758-63b8-4bc7-b518-93bacce38a12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:57.209436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d92758-63b8-4bc7-b518-93bacce38a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:57.211532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d92758-63b8-4bc7-b518-93bacce38a12 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:57.213815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b1403-1b46-4f68-870c-dd131c3c93f9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:57.226724 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 137/287] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:58:57.233633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d92758-63b8-4bc7-b518-93bacce38a12 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:57.258503 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc05348-7d89-45cd-8232-648444e7c4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:57.259783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05348-7d89-45cd-8232-648444e7c4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:57.260722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05348-7d89-45cd-8232-648444e7c4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:57.262131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05348-7d89-45cd-8232-648444e7c4e9 None admin] PATH_INFO: `/v3/users/33b31775859b40ef9eb3fea67e94fd11` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:57.263591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc05348-7d89-45cd-8232-648444e7c4e9 None admin] RBAC: Authorizing `identity:get_user(user_id=33b31775859b40ef9eb3fea67e94fd11)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:57.265140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:57.266813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc05348-7d89-45cd-8232-648444e7c4e9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:57.269653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 151/288] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:57 2022] GET /identity/v3/users/33b31775859b40ef9eb3fea67e94fd11 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:57.276070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc05348-7d89-45cd-8232-648444e7c4e9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:57.341924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:57.387231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d92758-63b8-4bc7-b518-93bacce38a12 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:57.433199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2b7f-57b5-4c5a-87df-fe87681448da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:57.434116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2b7f-57b5-4c5a-87df-fe87681448da None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:57.434399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2b7f-57b5-4c5a-87df-fe87681448da None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:57.434670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2b7f-57b5-4c5a-87df-fe87681448da None admin] PATH_INFO: `/v3/users/c8a7ceaa79764e3b95dedda84b1a1436` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:57.443074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c2b7f-57b5-4c5a-87df-fe87681448da None admin] RBAC: Authorizing `identity:get_user(user_id=c8a7ceaa79764e3b95dedda84b1a1436)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:57.444592 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c2b7f-57b5-4c5a-87df-fe87681448da None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:57.451908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 138/289] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:57 2022] GET /identity/v3/users/c8a7ceaa79764e3b95dedda84b1a1436 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:57.453446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2b7f-57b5-4c5a-87df-fe87681448da None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:57.520875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc05348-7d89-45cd-8232-648444e7c4e9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:57.567811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bc612-1d36-43f0-9f7b-79614d7a077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:57.568372 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bc612-1d36-43f0-9f7b-79614d7a077d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:57.568656 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bc612-1d36-43f0-9f7b-79614d7a077d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:57.568929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bc612-1d36-43f0-9f7b-79614d7a077d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:57.611985 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2b7f-57b5-4c5a-87df-fe87681448da None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:57.637964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:57.662312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bc612-1d36-43f0-9f7b-79614d7a077d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:57.663784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bc612-1d36-43f0-9f7b-79614d7a077d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:57.667809 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43d38e-0a96-4af7-8501-791d78511253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:57.670444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43d38e-0a96-4af7-8501-791d78511253 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:57.671009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43d38e-0a96-4af7-8501-791d78511253 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:57.671606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43d38e-0a96-4af7-8501-791d78511253 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:57.673350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43d38e-0a96-4af7-8501-791d78511253 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:57.675065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43d38e-0a96-4af7-8501-791d78511253 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:57.677489 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 139/290] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:57 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:57.686755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43d38e-0a96-4af7-8501-791d78511253 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:57.767115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:57.873304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43d38e-0a96-4af7-8501-791d78511253 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:57.875133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 152/291] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:58:57.879560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bc612-1d36-43f0-9f7b-79614d7a077d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:57.938865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f987681-3ec1-4031-910c-593c6234c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:57.939797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f987681-3ec1-4031-910c-593c6234c8a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:57.940073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f987681-3ec1-4031-910c-593c6234c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:57.940358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f987681-3ec1-4031-910c-593c6234c8a1 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c/users/c8a7ceaa79764e3b95dedda84b1a1436/roles/16a382e27714463d91383877be17fa0a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:57.948017 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f987681-3ec1-4031-910c-593c6234c8a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=346276b0f40e4a0c84018861d282281c, user_id=c8a7ceaa79764e3b95dedda84b1a1436, role_id=16a382e27714463d91383877be17fa0a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:57.949579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f987681-3ec1-4031-910c-593c6234c8a1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:57.981432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 140/292] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:58:57 2022] PUT /identity/v3/projects/346276b0f40e4a0c84018861d282281c/users/c8a7ceaa79764e3b95dedda84b1a1436/roles/16a382e27714463d91383877be17fa0a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:58:58.083825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bc612-1d36-43f0-9f7b-79614d7a077d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:58.136058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706350f-ef87-4407-8770-475c7cf073f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:58.136968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706350f-ef87-4407-8770-475c7cf073f2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:58.137275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706350f-ef87-4407-8770-475c7cf073f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:58.137552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706350f-ef87-4407-8770-475c7cf073f2 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:58.138997 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706350f-ef87-4407-8770-475c7cf073f2 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:58.140483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706350f-ef87-4407-8770-475c7cf073f2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:58.142328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 153/293] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:58:57 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:58.148654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f987681-3ec1-4031-910c-593c6234c8a1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:58.180539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:58.285693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f987681-3ec1-4031-910c-593c6234c8a1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:58.330223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb145e9a-afb9-4d15-8ba9-f3d51e0b2592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:58.330917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb145e9a-afb9-4d15-8ba9-f3d51e0b2592 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:58.331198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb145e9a-afb9-4d15-8ba9-f3d51e0b2592 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:58.331546 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb145e9a-afb9-4d15-8ba9-f3d51e0b2592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:58.332424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb145e9a-afb9-4d15-8ba9-f3d51e0b2592 None admin] RBAC: Adding query filter params (role.id=2b2ea3ada01041ad941dd5b6721df5b2, scope.project.id=346276b0f40e4a0c84018861d282281c, user.id=33b31775859b40ef9eb3fea67e94fd11) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:58.332736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb145e9a-afb9-4d15-8ba9-f3d51e0b2592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:58.334240 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb145e9a-afb9-4d15-8ba9-f3d51e0b2592 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:58.342140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 141/294] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:58:58 2022] GET /identity/v3/role_assignments?user.id=33b31775859b40ef9eb3fea67e94fd11&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:59.210475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271172eb-3b31-453d-9755-74a4ed9bfb62 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:59.211000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271172eb-3b31-453d-9755-74a4ed9bfb62 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:59.211000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271172eb-3b31-453d-9755-74a4ed9bfb62 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:59.212487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 154/295] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:59.218205 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4df5-09da-47e0-a814-42f326e2e9c7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:59.219066 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4df5-09da-47e0-a814-42f326e2e9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:59.219559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4df5-09da-47e0-a814-42f326e2e9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:59.240012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f49f4df5-09da-47e0-a814-42f326e2e9c7 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:59.241568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f49f4df5-09da-47e0-a814-42f326e2e9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:59.316590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 142/296] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:59.339822 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271172eb-3b31-453d-9755-74a4ed9bfb62 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:59.358210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:59.462242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271172eb-3b31-453d-9755-74a4ed9bfb62 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:59.502059 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb594-e2a7-4c3b-93f0-1c4bad4c959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:59.502941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb594-e2a7-4c3b-93f0-1c4bad4c959f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:59.503258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb594-e2a7-4c3b-93f0-1c4bad4c959f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:59.503539 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb594-e2a7-4c3b-93f0-1c4bad4c959f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:59.517003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdb594-e2a7-4c3b-93f0-1c4bad4c959f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:58:59.517612 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548d775-e2d1-4be5-a1a5-3f974bb8b44b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:59.517722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548d775-e2d1-4be5-a1a5-3f974bb8b44b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:59.518045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548d775-e2d1-4be5-a1a5-3f974bb8b44b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:59.519487 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 143/297] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-73fdb594-e2a7-4c3b-93f0-1c4bad4c959f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:58:59.525188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:58:59.527413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:58:59.528902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 155/298] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:58:59.530837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b6c4-105e-4831-9849-9cbf8ff408c0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:59.531325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b6c4-105e-4831-9849-9cbf8ff408c0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:59.531748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b6c4-105e-4831-9849-9cbf8ff408c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:59.534512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb594-e2a7-4c3b-93f0-1c4bad4c959f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:59.550983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1043b6c4-105e-4831-9849-9cbf8ff408c0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:59.552148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1043b6c4-105e-4831-9849-9cbf8ff408c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:59.554286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:59.621024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:59.629187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 144/299] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:58:59.631721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c1f7d-8780-422b-a5fa-c979e3147245 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:59.632016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c1f7d-8780-422b-a5fa-c979e3147245 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:59.632298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c1f7d-8780-422b-a5fa-c979e3147245 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:59.633920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 145/300] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:58:59.639221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c506d6b-687c-4a7c-a771-71a507c6e6b3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:59.639505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c506d6b-687c-4a7c-a771-71a507c6e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:59.639782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c506d6b-687c-4a7c-a771-71a507c6e6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:59.656073 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb594-e2a7-4c3b-93f0-1c4bad4c959f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:59.657264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5c506d6b-687c-4a7c-a771-71a507c6e6b3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:58:59.658987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5c506d6b-687c-4a7c-a771-71a507c6e6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:58:59.697848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557885d1-ed8b-4920-acff-fd6244d908c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:59.699309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557885d1-ed8b-4920-acff-fd6244d908c9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:59.700007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557885d1-ed8b-4920-acff-fd6244d908c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:59.700463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557885d1-ed8b-4920-acff-fd6244d908c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:59.702398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557885d1-ed8b-4920-acff-fd6244d908c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:58:59.703139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557885d1-ed8b-4920-acff-fd6244d908c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:59.705009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557885d1-ed8b-4920-acff-fd6244d908c9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:59.718810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 156/301] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:58:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:59.718810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557885d1-ed8b-4920-acff-fd6244d908c9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:59.757351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 146/302] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:58:59.758256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c506d6b-687c-4a7c-a771-71a507c6e6b3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:59.840110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:59.841230 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557885d1-ed8b-4920-acff-fd6244d908c9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:59.875937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaeb23-06ab-4ddd-af85-c5ede0fd44be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:59.876726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaeb23-06ab-4ddd-af85-c5ede0fd44be None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:59.877004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaeb23-06ab-4ddd-af85-c5ede0fd44be None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:59.877296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaeb23-06ab-4ddd-af85-c5ede0fd44be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:59.878448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaeb23-06ab-4ddd-af85-c5ede0fd44be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:59.879877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaeb23-06ab-4ddd-af85-c5ede0fd44be None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:59.881510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 157/303] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:58:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:59.881794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c506d6b-687c-4a7c-a771-71a507c6e6b3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:58:59.882260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaeb23-06ab-4ddd-af85-c5ede0fd44be None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:59.889306 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:58:59.924572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd508896-ac7c-4531-9fe7-7c2d39846640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:58:59.925715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd508896-ac7c-4531-9fe7-7c2d39846640 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:58:59.926213 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd508896-ac7c-4531-9fe7-7c2d39846640 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:58:59.926624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd508896-ac7c-4531-9fe7-7c2d39846640 None admin] PATH_INFO: `/v3/users/174cd8c064f44441a6ad4c56b5c829b9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:58:59.928154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd508896-ac7c-4531-9fe7-7c2d39846640 None admin] RBAC: Authorizing `identity:get_user(user_id=174cd8c064f44441a6ad4c56b5c829b9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:58:59.929900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd508896-ac7c-4531-9fe7-7c2d39846640 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:58:59.931793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 147/304] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:58:59 2022] GET /identity/v3/users/174cd8c064f44441a6ad4c56b5c829b9 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:58:59.932930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd508896-ac7c-4531-9fe7-7c2d39846640 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:58:59.994090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaeb23-06ab-4ddd-af85-c5ede0fd44be None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:00.029807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d203b-bfd6-4dcf-977a-7863fce9ffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:00.030610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d203b-bfd6-4dcf-977a-7863fce9ffb4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:00.030889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d203b-bfd6-4dcf-977a-7863fce9ffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:00.031159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d203b-bfd6-4dcf-977a-7863fce9ffb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:00.039360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd508896-ac7c-4531-9fe7-7c2d39846640 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:00.041704 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d203b-bfd6-4dcf-977a-7863fce9ffb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c89d203b-bfd6-4dcf-977a-7863fce9ffb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:00.049557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:00.050653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:00.051449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 158/305] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:58:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:00.052164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d203b-bfd6-4dcf-977a-7863fce9ffb4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:00.082615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b93b4d-3d84-4a1c-8630-3cdbb5346b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:00.083284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93b4d-3d84-4a1c-8630-3cdbb5346b7f None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:00.083563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93b4d-3d84-4a1c-8630-3cdbb5346b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:00.083837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93b4d-3d84-4a1c-8630-3cdbb5346b7f None admin] PATH_INFO: `/v3/groups` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:00.084522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b93b4d-3d84-4a1c-8630-3cdbb5346b7f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:00.085995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b93b4d-3d84-4a1c-8630-3cdbb5346b7f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:00.090673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:00.117237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 148/306] 10.222.0.45 () {60 vars in 1134 bytes} [Fri Jun 17 14:58:59 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:59:00.117237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b93b4d-3d84-4a1c-8630-3cdbb5346b7f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:00.128491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:00.178947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d203b-bfd6-4dcf-977a-7863fce9ffb4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:00.223430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a46d-b5a0-4949-b30b-95178182aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:00.224323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a46d-b5a0-4949-b30b-95178182aff7 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:00.224607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a46d-b5a0-4949-b30b-95178182aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:00.224887 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a46d-b5a0-4949-b30b-95178182aff7 None admin] PATH_INFO: `/v3/system/users/174cd8c064f44441a6ad4c56b5c829b9/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:00.226660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259a46d-b5a0-4949-b30b-95178182aff7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=174cd8c064f44441a6ad4c56b5c829b9, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:00.227896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259a46d-b5a0-4949-b30b-95178182aff7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:00.241277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 159/307] 10.222.0.45 () {58 vars in 1334 bytes} [Fri Jun 17 14:59:00 2022] PUT /identity/v3/system/users/174cd8c064f44441a6ad4c56b5c829b9/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:00.291696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b93b4d-3d84-4a1c-8630-3cdbb5346b7f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:00.337785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31496cb5-9ab3-4bf6-b1e1-4758feee275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:00.338845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31496cb5-9ab3-4bf6-b1e1-4758feee275a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:00.339272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31496cb5-9ab3-4bf6-b1e1-4758feee275a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:00.339925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31496cb5-9ab3-4bf6-b1e1-4758feee275a None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:00.340896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31496cb5-9ab3-4bf6-b1e1-4758feee275a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:00.341392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31496cb5-9ab3-4bf6-b1e1-4758feee275a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:00.342977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31496cb5-9ab3-4bf6-b1e1-4758feee275a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:00.358070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 149/308] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:00.363391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a46d-b5a0-4949-b30b-95178182aff7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:00.487080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a46d-b5a0-4949-b30b-95178182aff7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:00.515910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:00.526286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b6d3c-7ea2-434e-af3e-2575a012407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:00.527796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b6d3c-7ea2-434e-af3e-2575a012407f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:00.528074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b6d3c-7ea2-434e-af3e-2575a012407f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:00.528345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b6d3c-7ea2-434e-af3e-2575a012407f None admin] PATH_INFO: `/v3/users/d021d0a7394944c390b9610916f17b9f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:00.544900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b6d3c-7ea2-434e-af3e-2575a012407f None admin] RBAC: Authorizing `identity:get_user(user_id=d021d0a7394944c390b9610916f17b9f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:00.546803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b6d3c-7ea2-434e-af3e-2575a012407f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:00.549327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 160/309] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:59:00 2022] GET /identity/v3/users/d021d0a7394944c390b9610916f17b9f => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:00.558500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31496cb5-9ab3-4bf6-b1e1-4758feee275a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:00.594394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8b9b1-5c3d-4cfd-9f49-ad03eb3b6fa9 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:00.594674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8b9b1-5c3d-4cfd-9f49-ad03eb3b6fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:00.594947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8b9b1-5c3d-4cfd-9f49-ad03eb3b6fa9 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:00.596435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 161/310] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:59:00.603418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc139-783a-42ac-b53d-01fbc7f0e952 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:00.603970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc139-783a-42ac-b53d-01fbc7f0e952 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:00.604524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc139-783a-42ac-b53d-01fbc7f0e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:00.624676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-204fc139-783a-42ac-b53d-01fbc7f0e952 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:00.625960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-204fc139-783a-42ac-b53d-01fbc7f0e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:00.630078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:00.686071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31496cb5-9ab3-4bf6-b1e1-4758feee275a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:00.703138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 162/311] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:00.726292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fc139-783a-42ac-b53d-01fbc7f0e952 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:00.733403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423f5b-3c7b-489b-b08c-d1dcad2300bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:00.734398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423f5b-3c7b-489b-b08c-d1dcad2300bb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:00.734819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423f5b-3c7b-489b-b08c-d1dcad2300bb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:00.735259 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423f5b-3c7b-489b-b08c-d1dcad2300bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:00.736301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64423f5b-3c7b-489b-b08c-d1dcad2300bb None admin] RBAC: Adding query filter params (role.id=16a382e27714463d91383877be17fa0a, user.id=d021d0a7394944c390b9610916f17b9f, scope.system=all) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:00.736750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64423f5b-3c7b-489b-b08c-d1dcad2300bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:00.738466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64423f5b-3c7b-489b-b08c-d1dcad2300bb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:00.746246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 150/312] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Jun 17 14:59:00 2022] GET /identity/v3/role_assignments?user.id=d021d0a7394944c390b9610916f17b9f&scope.system=all&role.id=16a382e27714463d91383877be17fa0a => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:00.858251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fc139-783a-42ac-b53d-01fbc7f0e952 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:00.878513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:00.898815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725ac4-fb14-40d3-8632-e584c67cab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:00.899633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725ac4-fb14-40d3-8632-e584c67cab49 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:00.899912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725ac4-fb14-40d3-8632-e584c67cab49 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:00.900181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725ac4-fb14-40d3-8632-e584c67cab49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:00.913621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad725ac4-fb14-40d3-8632-e584c67cab49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ad725ac4-fb14-40d3-8632-e584c67cab49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:00.922192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:00.923213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:00.924086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 163/313] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:00.929588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423f5b-3c7b-489b-b08c-d1dcad2300bb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:01.041810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423f5b-3c7b-489b-b08c-d1dcad2300bb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:01.068647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:01.083716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52399e60-8e91-4301-b5ca-dab61d053128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:01.084511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52399e60-8e91-4301-b5ca-dab61d053128 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:01.084794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52399e60-8e91-4301-b5ca-dab61d053128 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:01.085070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52399e60-8e91-4301-b5ca-dab61d053128 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:01.085919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52399e60-8e91-4301-b5ca-dab61d053128 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:01.086225 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52399e60-8e91-4301-b5ca-dab61d053128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:01.087804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52399e60-8e91-4301-b5ca-dab61d053128 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:01.098368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 151/314] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:01.104371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725ac4-fb14-40d3-8632-e584c67cab49 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:01.211101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725ac4-fb14-40d3-8632-e584c67cab49 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:01.246998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f64fb-d13d-4547-a2c5-791622193656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:01.247994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f64fb-d13d-4547-a2c5-791622193656 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:01.248170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f64fb-d13d-4547-a2c5-791622193656 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:01.248526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f64fb-d13d-4547-a2c5-791622193656 None admin] PATH_INFO: `/v3/users/c8a7ceaa79764e3b95dedda84b1a1436` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:01.249666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f64fb-d13d-4547-a2c5-791622193656 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a7ceaa79764e3b95dedda84b1a1436)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:01.251108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f64fb-d13d-4547-a2c5-791622193656 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:01.253090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 164/315] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:59:01 2022] GET /identity/v3/users/c8a7ceaa79764e3b95dedda84b1a1436 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:01.258362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52399e60-8e91-4301-b5ca-dab61d053128 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:01.383737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52399e60-8e91-4301-b5ca-dab61d053128 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:01.426898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f037571-4f7c-493d-bc62-7aa1bffe0b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:01.427562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f037571-4f7c-493d-bc62-7aa1bffe0b33 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:01.427845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f037571-4f7c-493d-bc62-7aa1bffe0b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:01.428123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f037571-4f7c-493d-bc62-7aa1bffe0b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:01.497977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:01.514867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f037571-4f7c-493d-bc62-7aa1bffe0b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:01.516421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f037571-4f7c-493d-bc62-7aa1bffe0b33 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:01.647607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 152/316] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:01.653751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f64fb-d13d-4547-a2c5-791622193656 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:01.701619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:01.758134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f64fb-d13d-4547-a2c5-791622193656 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:01.793884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ca6c0-3e88-4697-9977-493d3bed4a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:01.793884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ca6c0-3e88-4697-9977-493d3bed4a4d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:01.794214 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ca6c0-3e88-4697-9977-493d3bed4a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:01.794346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ca6c0-3e88-4697-9977-493d3bed4a4d None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:01.801438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ca6c0-3e88-4697-9977-493d3bed4a4d None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:01.801438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ca6c0-3e88-4697-9977-493d3bed4a4d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:01.801438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 165/317] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:01 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:01.805022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f037571-4f7c-493d-bc62-7aa1bffe0b33 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:01.910906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f037571-4f7c-493d-bc62-7aa1bffe0b33 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:01.919993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:01.948802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e5f43-2a75-45a9-a24b-6450cd45f44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:01.949517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e5f43-2a75-45a9-a24b-6450cd45f44d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:01.949794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e5f43-2a75-45a9-a24b-6450cd45f44d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:01.950070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e5f43-2a75-45a9-a24b-6450cd45f44d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:01.950941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e5f43-2a75-45a9-a24b-6450cd45f44d None admin] RBAC: Adding query filter params (role.id=16a382e27714463d91383877be17fa0a, scope.project.id=346276b0f40e4a0c84018861d282281c, user.id=c8a7ceaa79764e3b95dedda84b1a1436) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:01.951256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e5f43-2a75-45a9-a24b-6450cd45f44d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:01.953143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e5f43-2a75-45a9-a24b-6450cd45f44d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:01.960371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 153/318] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:01 2022] GET /identity/v3/role_assignments?user.id=c8a7ceaa79764e3b95dedda84b1a1436&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=16a382e27714463d91383877be17fa0a => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:02.469126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3d335-7360-4387-ac19-6e4ce4e0ffec None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:02.469784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3d335-7360-4387-ac19-6e4ce4e0ffec None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:02.469784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3d335-7360-4387-ac19-6e4ce4e0ffec None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:02.471323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 166/319] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:02.476716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecb154-5718-4571-a2b9-152f00ec0c8e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:02.477253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecb154-5718-4571-a2b9-152f00ec0c8e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:02.477337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecb154-5718-4571-a2b9-152f00ec0c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:02.495344 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-44ecb154-5718-4571-a2b9-152f00ec0c8e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:02.496765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-44ecb154-5718-4571-a2b9-152f00ec0c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:02.573043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 154/320] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:02.596277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3d335-7360-4387-ac19-6e4ce4e0ffec None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:02.624008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04828b7-765b-43f5-8a0f-b9ab278ffc51 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:02.624295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04828b7-765b-43f5-8a0f-b9ab278ffc51 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:02.624565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04828b7-765b-43f5-8a0f-b9ab278ffc51 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:02.625996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 155/321] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:02.631920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919de9-022c-4bd1-aea3-621ba638e485 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:02.632405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919de9-022c-4bd1-aea3-621ba638e485 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:02.632776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919de9-022c-4bd1-aea3-621ba638e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:02.650933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a8919de9-022c-4bd1-aea3-621ba638e485 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:02.652146 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a8919de9-022c-4bd1-aea3-621ba638e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:02.722629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3d335-7360-4387-ac19-6e4ce4e0ffec None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:02.733282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 156/322] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:02.737764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:02.756880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8919de9-022c-4bd1-aea3-621ba638e485 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:02.766839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277d514-0381-4421-9357-ed12bf4d3920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:02.767643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277d514-0381-4421-9357-ed12bf4d3920 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:02.767891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277d514-0381-4421-9357-ed12bf4d3920 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:02.768194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277d514-0381-4421-9357-ed12bf4d3920 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:02.769403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277d514-0381-4421-9357-ed12bf4d3920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:02.770875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277d514-0381-4421-9357-ed12bf4d3920 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:02.772043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:02.772659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 167/323] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:02.778100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277d514-0381-4421-9357-ed12bf4d3920 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:02.890515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8919de9-022c-4bd1-aea3-621ba638e485 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:02.913195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277d514-0381-4421-9357-ed12bf4d3920 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:02.932309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159a082-f4c0-4e83-9d94-3666b2c2d378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:02.933235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159a082-f4c0-4e83-9d94-3666b2c2d378 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:02.933542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159a082-f4c0-4e83-9d94-3666b2c2d378 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:02.933814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159a082-f4c0-4e83-9d94-3666b2c2d378 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:02.947327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159a082-f4c0-4e83-9d94-3666b2c2d378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1159a082-f4c0-4e83-9d94-3666b2c2d378 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:02.955839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:02.956850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:02.957715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 157/324] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:02.962631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ac6e0-0bd1-4a63-85fb-a01fd62eb00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:02.963321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159a082-f4c0-4e83-9d94-3666b2c2d378 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:02.963887 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac6e0-0bd1-4a63-85fb-a01fd62eb00e None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:02.964489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac6e0-0bd1-4a63-85fb-a01fd62eb00e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:02.964946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac6e0-0bd1-4a63-85fb-a01fd62eb00e None admin] PATH_INFO: `/v3/groups` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:02.966683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ac6e0-0bd1-4a63-85fb-a01fd62eb00e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:02.968677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ac6e0-0bd1-4a63-85fb-a01fd62eb00e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:02.990034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 168/325] 10.222.0.45 () {60 vars in 1134 bytes} [Fri Jun 17 14:59:02 2022] POST /identity/v3/groups => generated 226 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 14:59:03.027841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6a95f-5a34-4a60-ae7a-5600c4cbecd9 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:03.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6a95f-5a34-4a60-ae7a-5600c4cbecd9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:03.028470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6a95f-5a34-4a60-ae7a-5600c4cbecd9 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:03.030777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 169/326] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:03.036404 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f20fc-bd49-4b34-8f95-88ff65a7d01d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:03.036657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f20fc-bd49-4b34-8f95-88ff65a7d01d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:03.036931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f20fc-bd49-4b34-8f95-88ff65a7d01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:03.055444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1f2f20fc-bd49-4b34-8f95-88ff65a7d01d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:03.056713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1f2f20fc-bd49-4b34-8f95-88ff65a7d01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:03.063661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:03.100144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:03.110916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159a082-f4c0-4e83-9d94-3666b2c2d378 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:03.145606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 170/327] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:03.154813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079572dc-9c40-4573-8cbf-3ffe87db8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:03.155506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079572dc-9c40-4573-8cbf-3ffe87db8c9b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:03.155786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079572dc-9c40-4573-8cbf-3ffe87db8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:03.156062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079572dc-9c40-4573-8cbf-3ffe87db8c9b None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:03.156828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079572dc-9c40-4573-8cbf-3ffe87db8c9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:03.157136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079572dc-9c40-4573-8cbf-3ffe87db8c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:03.158604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079572dc-9c40-4573-8cbf-3ffe87db8c9b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:03.168334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f20fc-bd49-4b34-8f95-88ff65a7d01d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:03.169085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 158/328] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:03.176290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079572dc-9c40-4573-8cbf-3ffe87db8c9b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:03.304666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f20fc-bd49-4b34-8f95-88ff65a7d01d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:03.322088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079572dc-9c40-4573-8cbf-3ffe87db8c9b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:03.359797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd60f95-39f6-4527-b81a-6dea7d70f36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:03.360607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd60f95-39f6-4527-b81a-6dea7d70f36d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:03.360882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd60f95-39f6-4527-b81a-6dea7d70f36d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:03.361136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd60f95-39f6-4527-b81a-6dea7d70f36d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:03.367362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:03.377464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b55d5-5dc4-4cc4-ba78-48d01e0486db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:03.378460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b55d5-5dc4-4cc4-ba78-48d01e0486db None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:03.378647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd60f95-39f6-4527-b81a-6dea7d70f36d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:03.378753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b55d5-5dc4-4cc4-ba78-48d01e0486db None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:03.379011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b55d5-5dc4-4cc4-ba78-48d01e0486db None admin] PATH_INFO: `/v3/users/174cd8c064f44441a6ad4c56b5c829b9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:03.380508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b55d5-5dc4-4cc4-ba78-48d01e0486db None admin] RBAC: Authorizing `identity:get_user(user_id=174cd8c064f44441a6ad4c56b5c829b9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:03.382295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b55d5-5dc4-4cc4-ba78-48d01e0486db None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:03.384356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 159/329] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:59:03 2022] GET /identity/v3/users/174cd8c064f44441a6ad4c56b5c829b9 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-6dd60f95-39f6-4527-b81a-6dea7d70f36d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:03.390810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:03.391735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:03.392531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 171/330] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:03.395127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b55d5-5dc4-4cc4-ba78-48d01e0486db None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:03.400245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd60f95-39f6-4527-b81a-6dea7d70f36d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:03.445000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:03.555430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b55d5-5dc4-4cc4-ba78-48d01e0486db None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:03.570138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd60f95-39f6-4527-b81a-6dea7d70f36d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:03.605143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f4b7e-ae64-487b-ad60-c416c11851a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:03.605856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4b7e-ae64-487b-ad60-c416c11851a3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:03.606147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4b7e-ae64-487b-ad60-c416c11851a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:03.606437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4b7e-ae64-487b-ad60-c416c11851a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:03.607616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f4b7e-ae64-487b-ad60-c416c11851a3 None admin] RBAC: Adding query filter params (role.id=2b2ea3ada01041ad941dd5b6721df5b2, user.id=174cd8c064f44441a6ad4c56b5c829b9, scope.system=all) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:03.607939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f4b7e-ae64-487b-ad60-c416c11851a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:03.609794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f4b7e-ae64-487b-ad60-c416c11851a3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:03.618282 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c7642-2ea2-451b-a945-125af056348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:03.619426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c7642-2ea2-451b-a945-125af056348c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:03.619883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c7642-2ea2-451b-a945-125af056348c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:03.621247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c7642-2ea2-451b-a945-125af056348c None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:03.623797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c7642-2ea2-451b-a945-125af056348c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:03.624292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c7642-2ea2-451b-a945-125af056348c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:03.626308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 160/331] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Jun 17 14:59:03 2022] GET /identity/v3/role_assignments?user.id=174cd8c064f44441a6ad4c56b5c829b9&scope.system=all&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 510 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:03.626865 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c7642-2ea2-451b-a945-125af056348c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:03.646686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 172/332] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:03.653525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f4b7e-ae64-487b-ad60-c416c11851a3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:03.724982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:03.777188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f4b7e-ae64-487b-ad60-c416c11851a3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:03.816927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeaddc-1d0d-45b8-bae9-6bd819e754c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:03.817782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeaddc-1d0d-45b8-bae9-6bd819e754c3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:03.818065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeaddc-1d0d-45b8-bae9-6bd819e754c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:03.818346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeaddc-1d0d-45b8-bae9-6bd819e754c3 None admin] PATH_INFO: `/v3/users/d021d0a7394944c390b9610916f17b9f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:03.819675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeaddc-1d0d-45b8-bae9-6bd819e754c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d021d0a7394944c390b9610916f17b9f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:03.821182 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeaddc-1d0d-45b8-bae9-6bd819e754c3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:03.823521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 161/333] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:59:03 2022] GET /identity/v3/users/d021d0a7394944c390b9610916f17b9f => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:03.830555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c7642-2ea2-451b-a945-125af056348c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:03.955451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:03.965768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c7642-2ea2-451b-a945-125af056348c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:04.020035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3ef4-dea2-40cb-99d8-24f997e50559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:04.020926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3ef4-dea2-40cb-99d8-24f997e50559 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:04.021229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3ef4-dea2-40cb-99d8-24f997e50559 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:04.021509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3ef4-dea2-40cb-99d8-24f997e50559 None admin] PATH_INFO: `/v3/system/users/d021d0a7394944c390b9610916f17b9f/roles/16a382e27714463d91383877be17fa0a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:04.024014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b3ef4-dea2-40cb-99d8-24f997e50559 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d021d0a7394944c390b9610916f17b9f, role_id=16a382e27714463d91383877be17fa0a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:04.025456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b3ef4-dea2-40cb-99d8-24f997e50559 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:04.037011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 173/334] 10.222.0.45 () {58 vars in 1334 bytes} [Fri Jun 17 14:59:03 2022] PUT /identity/v3/system/users/d021d0a7394944c390b9610916f17b9f/roles/16a382e27714463d91383877be17fa0a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:05.746321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec28b-9e86-4bd7-aaba-448a27f0bed1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:05.747451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec28b-9e86-4bd7-aaba-448a27f0bed1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:05.747956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec28b-9e86-4bd7-aaba-448a27f0bed1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:05.749968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 162/335] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:05.755393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f5923-92ed-42a0-a909-b58cdcb89bad None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:05.756331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f5923-92ed-42a0-a909-b58cdcb89bad None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:05.756798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f5923-92ed-42a0-a909-b58cdcb89bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:05.775123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-914f5923-92ed-42a0-a909-b58cdcb89bad None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:05.776732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-914f5923-92ed-42a0-a909-b58cdcb89bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:05.886295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 174/336] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:05.943615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aec28b-9e86-4bd7-aaba-448a27f0bed1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:06.078625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aec28b-9e86-4bd7-aaba-448a27f0bed1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:06.119188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3dbe5-4996-46de-83f4-7c3106c8cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:06.120084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3dbe5-4996-46de-83f4-7c3106c8cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:06.120385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3dbe5-4996-46de-83f4-7c3106c8cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:06.120668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3dbe5-4996-46de-83f4-7c3106c8cbf1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:06.129608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:06.137006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3dbe5-4996-46de-83f4-7c3106c8cbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7ce3dbe5-4996-46de-83f4-7c3106c8cbf1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:06.145024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:06.145920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:06.146693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:06.149406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 163/337] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:06.158373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f5923-92ed-42a0-a909-b58cdcb89bad None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:06.318369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:06.338946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f5923-92ed-42a0-a909-b58cdcb89bad None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:06.374930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca2fc-0a62-44ea-92e5-d47a49b81a0e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:06.375599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca2fc-0a62-44ea-92e5-d47a49b81a0e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:06.376045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca2fc-0a62-44ea-92e5-d47a49b81a0e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:06.377949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 164/338] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:06.384253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662e951-bd04-4940-8da2-3e32d6176c25 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:06.385532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662e951-bd04-4940-8da2-3e32d6176c25 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:06.386038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662e951-bd04-4940-8da2-3e32d6176c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:06.403422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad21608-f639-41b6-b80d-34da72a2c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:06.404382 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad21608-f639-41b6-b80d-34da72a2c4ed None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:06.404798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad21608-f639-41b6-b80d-34da72a2c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:06.405146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad21608-f639-41b6-b80d-34da72a2c4ed None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:06.406119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad21608-f639-41b6-b80d-34da72a2c4ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:06.406634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad21608-f639-41b6-b80d-34da72a2c4ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:06.407947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6662e951-bd04-4940-8da2-3e32d6176c25 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:06.409013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad21608-f639-41b6-b80d-34da72a2c4ed None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:06.409586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6662e951-bd04-4940-8da2-3e32d6176c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:06.434020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 175/339] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:06.440317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad21608-f639-41b6-b80d-34da72a2c4ed None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:06.494020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 165/340] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:06.577768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662e951-bd04-4940-8da2-3e32d6176c25 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:06.647036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad21608-f639-41b6-b80d-34da72a2c4ed None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:06.742875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af0cd-b94b-4e3b-becc-493dd3f9e5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:06.743602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af0cd-b94b-4e3b-becc-493dd3f9e5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:06.743888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af0cd-b94b-4e3b-becc-493dd3f9e5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:06.744153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af0cd-b94b-4e3b-becc-493dd3f9e5a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:06.779164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:06.871702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662e951-bd04-4940-8da2-3e32d6176c25 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:06.894189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133af0cd-b94b-4e3b-becc-493dd3f9e5a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:06.895666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133af0cd-b94b-4e3b-becc-493dd3f9e5a0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:06.910669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:06.975022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3de01e-df93-4e3b-9b86-0845989d2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:06.976270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3de01e-df93-4e3b-9b86-0845989d2df8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:06.977136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3de01e-df93-4e3b-9b86-0845989d2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:06.977850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3de01e-df93-4e3b-9b86-0845989d2df8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:07.010229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3de01e-df93-4e3b-9b86-0845989d2df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ca3de01e-df93-4e3b-9b86-0845989d2df8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:07.019270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:07.020300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:07.021095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:07.023975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 166/341] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:59:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:07.034882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3de01e-df93-4e3b-9b86-0845989d2df8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:07.115014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 176/342] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:07.129631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af0cd-b94b-4e3b-becc-493dd3f9e5a0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:07.260411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:07.291442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3de01e-df93-4e3b-9b86-0845989d2df8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:07.371652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af0cd-b94b-4e3b-becc-493dd3f9e5a0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:07.406082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdcfbd-284a-45c0-b45d-a58b851b9d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:07.406782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdcfbd-284a-45c0-b45d-a58b851b9d67 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:07.407067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdcfbd-284a-45c0-b45d-a58b851b9d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:07.407350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdcfbd-284a-45c0-b45d-a58b851b9d67 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:07.408110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdcfbd-284a-45c0-b45d-a58b851b9d67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:07.408418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdcfbd-284a-45c0-b45d-a58b851b9d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:07.409859 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdcfbd-284a-45c0-b45d-a58b851b9d67 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:07.412621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72712d-1d4a-418b-bca3-c890c0e5b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:07.414679 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72712d-1d4a-418b-bca3-c890c0e5b0ef None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:07.415223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72712d-1d4a-418b-bca3-c890c0e5b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:07.415713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72712d-1d4a-418b-bca3-c890c0e5b0ef None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:07.417962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72712d-1d4a-418b-bca3-c890c0e5b0ef None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:07.420453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72712d-1d4a-418b-bca3-c890c0e5b0ef None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:07.423132 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 177/343] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:07 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:07.425695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4572-7eaa-4c8a-ae7c-5fa676bbd334 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:07.426310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4572-7eaa-4c8a-ae7c-5fa676bbd334 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:07.426804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4572-7eaa-4c8a-ae7c-5fa676bbd334 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:07.432816 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 178/344] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:07.435006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ba4d9-69ff-4514-a1b3-38f2d199e3dc None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:07.435291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ba4d9-69ff-4514-a1b3-38f2d199e3dc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:07.435566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ba4d9-69ff-4514-a1b3-38f2d199e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:07.443572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 167/345] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:07.444287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdcfbd-284a-45c0-b45d-a58b851b9d67 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:07.482467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7c3ba4d9-69ff-4514-a1b3-38f2d199e3dc None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:07.483686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7c3ba4d9-69ff-4514-a1b3-38f2d199e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:07.491515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:07.591366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 179/346] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:07.592652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ba4d9-69ff-4514-a1b3-38f2d199e3dc None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:07.595521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdcfbd-284a-45c0-b45d-a58b851b9d67 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:07.640885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75048b-824b-4acd-a722-dce84f7c3e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:07.640885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75048b-824b-4acd-a722-dce84f7c3e39 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:07.640885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75048b-824b-4acd-a722-dce84f7c3e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:07.640885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75048b-824b-4acd-a722-dce84f7c3e39 None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:07.648772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75048b-824b-4acd-a722-dce84f7c3e39 None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:07.650509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75048b-824b-4acd-a722-dce84f7c3e39 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:07.652778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 168/347] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:07 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:07.653992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13fe5-28d1-4c46-9e5f-94001919efcd None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:07.654178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:07.654279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13fe5-28d1-4c46-9e5f-94001919efcd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:07.654532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13fe5-28d1-4c46-9e5f-94001919efcd None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:07.655904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 169/348] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:07.659127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd593e6-2ef7-49bc-9423-039859f3e258 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:07.659127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd593e6-2ef7-49bc-9423-039859f3e258 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:07.659127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd593e6-2ef7-49bc-9423-039859f3e258 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:07.659127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 170/349] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:07.659876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd593e6-2ef7-49bc-9423-039859f3e258 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:07.732605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ba4d9-69ff-4514-a1b3-38f2d199e3dc None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:07.778011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fe9f3-787e-4f7a-b055-7d67a0d617a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:07.778769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fe9f3-787e-4f7a-b055-7d67a0d617a0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:07.779052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fe9f3-787e-4f7a-b055-7d67a0d617a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:07.779323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fe9f3-787e-4f7a-b055-7d67a0d617a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:07.797856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:07.802790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd593e6-2ef7-49bc-9423-039859f3e258 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:07.842917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165d501-299b-407f-ac61-be9d6f418abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:07.843260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165d501-299b-407f-ac61-be9d6f418abb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:07.844171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165d501-299b-407f-ac61-be9d6f418abb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:07.844171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165d501-299b-407f-ac61-be9d6f418abb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:07.858679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165d501-299b-407f-ac61-be9d6f418abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c165d501-299b-407f-ac61-be9d6f418abb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:07.866867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:07.867861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:07.868652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:07.869478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 171/350] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:07.875143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165d501-299b-407f-ac61-be9d6f418abb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:07.881364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9fe9f3-787e-4f7a-b055-7d67a0d617a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:07.882842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9fe9f3-787e-4f7a-b055-7d67a0d617a0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:07.935403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:08.001123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165d501-299b-407f-ac61-be9d6f418abb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:08.019396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 180/351] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:08.020721 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d040ec4-9cda-4820-b266-2ddbe1ebb6ec None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.021025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d040ec4-9cda-4820-b266-2ddbe1ebb6ec None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.021374 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d040ec4-9cda-4820-b266-2ddbe1ebb6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.038987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7d040ec4-9cda-4820-b266-2ddbe1ebb6ec None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:08.040457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7d040ec4-9cda-4820-b266-2ddbe1ebb6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:08.049974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a17bbd-2fec-47a7-aefa-f08af1a38667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:08.050652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a17bbd-2fec-47a7-aefa-f08af1a38667 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.050932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a17bbd-2fec-47a7-aefa-f08af1a38667 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.051206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a17bbd-2fec-47a7-aefa-f08af1a38667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.052442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a17bbd-2fec-47a7-aefa-f08af1a38667 None admin] RBAC: Adding query filter params (group.id=998d809837864c208becc5d92a608db5, role.id=2b2ea3ada01041ad941dd5b6721df5b2, scope.project.id=df2e2d29dd144c198fac526f80a50009) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:08.052755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a17bbd-2fec-47a7-aefa-f08af1a38667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:08.054750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a17bbd-2fec-47a7-aefa-f08af1a38667 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:08.063410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 172/352] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 17 14:59:07 2022] GET /identity/v3/role_assignments?group.id=998d809837864c208becc5d92a608db5&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:08.064169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c328-5787-46ab-96b5-e32d5acf91af None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.064581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c328-5787-46ab-96b5-e32d5acf91af None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.064982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c328-5787-46ab-96b5-e32d5acf91af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.090166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bed6c328-5787-46ab-96b5-e32d5acf91af None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:08.092262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bed6c328-5787-46ab-96b5-e32d5acf91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:08.129367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:08.142507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 181/353] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:08.143291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d040ec4-9cda-4820-b266-2ddbe1ebb6ec None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:08.195006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 173/354] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:08.196914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7907c42-3307-4096-9545-edf483308c5c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.197397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7907c42-3307-4096-9545-edf483308c5c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.197816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7907c42-3307-4096-9545-edf483308c5c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.199683 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 174/355] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:08.200644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7907c42-3307-4096-9545-edf483308c5c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:08.239339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:08.278031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d040ec4-9cda-4820-b266-2ddbe1ebb6ec None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:08.342943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9464ca0-3687-4108-a88d-8b7d9222c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:08.343650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464ca0-3687-4108-a88d-8b7d9222c639 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.343936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464ca0-3687-4108-a88d-8b7d9222c639 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.344215 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464ca0-3687-4108-a88d-8b7d9222c639 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.344980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9464ca0-3687-4108-a88d-8b7d9222c639 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:08.345437 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9464ca0-3687-4108-a88d-8b7d9222c639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:08.346839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9464ca0-3687-4108-a88d-8b7d9222c639 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:08.360049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 182/356] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:08.365275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9464ca0-3687-4108-a88d-8b7d9222c639 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:08.372486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7907c42-3307-4096-9545-edf483308c5c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:08.424528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0501a7-7494-4540-ba05-eeffc3b83c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:08.425421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0501a7-7494-4540-ba05-eeffc3b83c64 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.425751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0501a7-7494-4540-ba05-eeffc3b83c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.426028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0501a7-7494-4540-ba05-eeffc3b83c64 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.427929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0501a7-7494-4540-ba05-eeffc3b83c64 None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:08.429704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0501a7-7494-4540-ba05-eeffc3b83c64 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:08.433619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 175/357] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:08 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:08.434922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e548-48d4-4bae-8774-fb95967a4795 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.435218 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e548-48d4-4bae-8774-fb95967a4795 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.435616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e548-48d4-4bae-8774-fb95967a4795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.456656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4870e548-48d4-4bae-8774-fb95967a4795 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:08.458289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4870e548-48d4-4bae-8774-fb95967a4795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:08.481472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:08.520315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9464ca0-3687-4108-a88d-8b7d9222c639 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:08.565751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 176/358] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:08.567598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870e548-48d4-4bae-8774-fb95967a4795 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:08.574252 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e84942-01c3-4de9-a895-2653a24ad8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:08.575513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e84942-01c3-4de9-a895-2653a24ad8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.575982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e84942-01c3-4de9-a895-2653a24ad8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.576619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e84942-01c3-4de9-a895-2653a24ad8d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.586400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:08.594121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e84942-01c3-4de9-a895-2653a24ad8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b7e84942-01c3-4de9-a895-2653a24ad8d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:08.602899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:08.603927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:08.604896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 183/359] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:08.606026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e84942-01c3-4de9-a895-2653a24ad8d2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:08.709063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870e548-48d4-4bae-8774-fb95967a4795 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:08.757891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e84942-01c3-4de9-a895-2653a24ad8d2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:08.758155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cc4b9-a018-42c9-8bf2-f0538f09a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:08.758978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cc4b9-a018-42c9-8bf2-f0538f09a6dd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.759263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cc4b9-a018-42c9-8bf2-f0538f09a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.759769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cc4b9-a018-42c9-8bf2-f0538f09a6dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.777247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cc4b9-a018-42c9-8bf2-f0538f09a6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-733cc4b9-a018-42c9-8bf2-f0538f09a6dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:08.788719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:08.789818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:08.790662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 177/360] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:59:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:08.791494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cc4b9-a018-42c9-8bf2-f0538f09a6dd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:08.811874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:08.819845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863556b-c65e-4005-9e47-ba291d51b71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:08.820520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863556b-c65e-4005-9e47-ba291d51b71c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.820791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863556b-c65e-4005-9e47-ba291d51b71c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.821065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863556b-c65e-4005-9e47-ba291d51b71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.909828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:08.914058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863556b-c65e-4005-9e47-ba291d51b71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:08.920163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863556b-c65e-4005-9e47-ba291d51b71c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:08.933535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cc4b9-a018-42c9-8bf2-f0538f09a6dd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:08.985890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba642d5-938b-48f1-af90-f4ef3dce4be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:08.985890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba642d5-938b-48f1-af90-f4ef3dce4be8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:08.986166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba642d5-938b-48f1-af90-f4ef3dce4be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:08.986567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba642d5-938b-48f1-af90-f4ef3dce4be8 None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:08.988391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba642d5-938b-48f1-af90-f4ef3dce4be8 None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:08.990420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba642d5-938b-48f1-af90-f4ef3dce4be8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:08.993056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 178/361] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:08 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:08.994101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba642d5-938b-48f1-af90-f4ef3dce4be8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:09.083884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 184/362] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:09.085663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863556b-c65e-4005-9e47-ba291d51b71c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:09.119139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:09.143470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba642d5-938b-48f1-af90-f4ef3dce4be8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:09.186608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9a844-17ff-45c4-aea1-06d7447daba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:09.187473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9a844-17ff-45c4-aea1-06d7447daba3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:09.187953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9a844-17ff-45c4-aea1-06d7447daba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:09.188374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9a844-17ff-45c4-aea1-06d7447daba3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:09.204726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9a844-17ff-45c4-aea1-06d7447daba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-88b9a844-17ff-45c4-aea1-06d7447daba3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:09.212586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:09.213586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:09.214415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:09.215024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 179/363] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:09.220388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9a844-17ff-45c4-aea1-06d7447daba3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:09.228514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:09.238665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863556b-c65e-4005-9e47-ba291d51b71c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:09.287803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720dc9a-4f1c-486d-aa09-1dfc18e8468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:09.287803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720dc9a-4f1c-486d-aa09-1dfc18e8468a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:09.288095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720dc9a-4f1c-486d-aa09-1dfc18e8468a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:09.288476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720dc9a-4f1c-486d-aa09-1dfc18e8468a None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:09.289717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720dc9a-4f1c-486d-aa09-1dfc18e8468a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:09.290970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720dc9a-4f1c-486d-aa09-1dfc18e8468a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:09.291362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720dc9a-4f1c-486d-aa09-1dfc18e8468a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:09.301090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 185/364] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:09.302063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720dc9a-4f1c-486d-aa09-1dfc18e8468a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:09.379284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9a844-17ff-45c4-aea1-06d7447daba3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:09.421199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6a2a-45f4-4e6b-bff8-54d004ab03da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:09.421919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6a2a-45f4-4e6b-bff8-54d004ab03da None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:09.422200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6a2a-45f4-4e6b-bff8-54d004ab03da None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:09.422477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6a2a-45f4-4e6b-bff8-54d004ab03da None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:09.423232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6a2a-45f4-4e6b-bff8-54d004ab03da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:09.423539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6a2a-45f4-4e6b-bff8-54d004ab03da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:09.424943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6a2a-45f4-4e6b-bff8-54d004ab03da None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:09.435543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 180/365] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:09.436275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6a2a-45f4-4e6b-bff8-54d004ab03da None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:09.439704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:09.454918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720dc9a-4f1c-486d-aa09-1dfc18e8468a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:09.505826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecdce5-0a09-45fc-a6b2-8efa1196c046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:09.506573 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecdce5-0a09-45fc-a6b2-8efa1196c046 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:09.506909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecdce5-0a09-45fc-a6b2-8efa1196c046 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:09.507147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecdce5-0a09-45fc-a6b2-8efa1196c046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:09.507969 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecdce5-0a09-45fc-a6b2-8efa1196c046 None admin] RBAC: Adding query filter params (group.id=998d809837864c208becc5d92a608db5, role.id=f36f89c30b0a4c38900202ea156ed20e, scope.project.id=df2e2d29dd144c198fac526f80a50009) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:09.508364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecdce5-0a09-45fc-a6b2-8efa1196c046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:09.512451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecdce5-0a09-45fc-a6b2-8efa1196c046 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:09.518495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 186/366] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 17 14:59:09 2022] GET /identity/v3/role_assignments?group.id=998d809837864c208becc5d92a608db5&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=f36f89c30b0a4c38900202ea156ed20e => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:09.519346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecdce5-0a09-45fc-a6b2-8efa1196c046 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:09.587287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6a2a-45f4-4e6b-bff8-54d004ab03da None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:09.593679 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:09.645264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0fb5-0737-4c57-9237-ef6c7d23c250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:09.646846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0fb5-0737-4c57-9237-ef6c7d23c250 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:09.647867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0fb5-0737-4c57-9237-ef6c7d23c250 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:09.648225 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0fb5-0737-4c57-9237-ef6c7d23c250 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:09.649707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec0fb5-0737-4c57-9237-ef6c7d23c250 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:09.651461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec0fb5-0737-4c57-9237-ef6c7d23c250 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:09.653843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 181/367] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:09 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:09.655717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0fb5-0737-4c57-9237-ef6c7d23c250 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:09.673647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecdce5-0a09-45fc-a6b2-8efa1196c046 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:09.725829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e548b70-7fa2-4146-a75e-5a65e9c4856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:09.727869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e548b70-7fa2-4146-a75e-5a65e9c4856f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:09.727869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e548b70-7fa2-4146-a75e-5a65e9c4856f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:09.727869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e548b70-7fa2-4146-a75e-5a65e9c4856f None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:09.728235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e548b70-7fa2-4146-a75e-5a65e9c4856f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:09.728546 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e548b70-7fa2-4146-a75e-5a65e9c4856f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:09.730401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e548b70-7fa2-4146-a75e-5a65e9c4856f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:09.741608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 187/368] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:09.742481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e548b70-7fa2-4146-a75e-5a65e9c4856f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:09.760018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:09.820725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0fb5-0737-4c57-9237-ef6c7d23c250 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:09.867327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46d005-f94f-444c-a53a-e68700832469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:09.868380 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46d005-f94f-444c-a53a-e68700832469 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:09.868763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46d005-f94f-444c-a53a-e68700832469 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:09.869062 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:09.869522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46d005-f94f-444c-a53a-e68700832469 None admin] PATH_INFO: `/v3/users/d021d0a7394944c390b9610916f17b9f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:09.870735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46d005-f94f-444c-a53a-e68700832469 None admin] RBAC: Authorizing `identity:get_user(user_id=d021d0a7394944c390b9610916f17b9f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:09.872349 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46d005-f94f-444c-a53a-e68700832469 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:09.874383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 182/369] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 14:59:09 2022] GET /identity/v3/users/d021d0a7394944c390b9610916f17b9f => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:09.875281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46d005-f94f-444c-a53a-e68700832469 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:09.892327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e548b70-7fa2-4146-a75e-5a65e9c4856f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:09.946091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c064379-4362-49ca-b9f2-8d962ea74b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:09.946749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064379-4362-49ca-b9f2-8d962ea74b1a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:09.947031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064379-4362-49ca-b9f2-8d962ea74b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:09.947308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064379-4362-49ca-b9f2-8d962ea74b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:10.008715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46d005-f94f-444c-a53a-e68700832469 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:10.045067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c064379-4362-49ca-b9f2-8d962ea74b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:10.046646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c064379-4362-49ca-b9f2-8d962ea74b1a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:10.049032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41bd4-4be2-4cb9-b284-03f0b4055573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:10.050057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41bd4-4be2-4cb9-b284-03f0b4055573 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:10.050439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41bd4-4be2-4cb9-b284-03f0b4055573 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:10.050814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41bd4-4be2-4cb9-b284-03f0b4055573 None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:10.052135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41bd4-4be2-4cb9-b284-03f0b4055573 None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:10.053823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41bd4-4be2-4cb9-b284-03f0b4055573 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:10.055608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 183/370] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:09 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:10.062332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41bd4-4be2-4cb9-b284-03f0b4055573 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:10.075113 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:10.170246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:10.191512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 188/371] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:10.192448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c064379-4362-49ca-b9f2-8d962ea74b1a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:10.203276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41bd4-4be2-4cb9-b284-03f0b4055573 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:10.242317 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6dfcd-2ef1-4f8f-b991-ce7548035f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:10.243193 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6dfcd-2ef1-4f8f-b991-ce7548035f8a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:10.243691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6dfcd-2ef1-4f8f-b991-ce7548035f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:10.244104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6dfcd-2ef1-4f8f-b991-ce7548035f8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:10.317444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c064379-4362-49ca-b9f2-8d962ea74b1a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:10.333322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6dfcd-2ef1-4f8f-b991-ce7548035f8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:10.335007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6dfcd-2ef1-4f8f-b991-ce7548035f8a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:10.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:10.365691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f889359-7936-4315-930e-fc502c807a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:10.366643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f889359-7936-4315-930e-fc502c807a4e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:10.366927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f889359-7936-4315-930e-fc502c807a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:10.367206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f889359-7936-4315-930e-fc502c807a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:10.368700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f889359-7936-4315-930e-fc502c807a4e None admin] RBAC: Adding query filter params (role.id=16a382e27714463d91383877be17fa0a, user.id=d021d0a7394944c390b9610916f17b9f, scope.system=all) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:10.369024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f889359-7936-4315-930e-fc502c807a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:10.370764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f889359-7936-4315-930e-fc502c807a4e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:10.387872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 189/372] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Jun 17 14:59:10 2022] GET /identity/v3/role_assignments?user.id=d021d0a7394944c390b9610916f17b9f&scope.system=all&role.id=16a382e27714463d91383877be17fa0a => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:10.393875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f889359-7936-4315-930e-fc502c807a4e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:10.501902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:10.548574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 184/373] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:10.549564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6dfcd-2ef1-4f8f-b991-ce7548035f8a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:10.617977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f889359-7936-4315-930e-fc502c807a4e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:10.663030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c667a46-10eb-4229-8b2a-03f6ca174c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:10.663694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c667a46-10eb-4229-8b2a-03f6ca174c80 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:10.663970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c667a46-10eb-4229-8b2a-03f6ca174c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:10.664244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c667a46-10eb-4229-8b2a-03f6ca174c80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:10.665070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c667a46-10eb-4229-8b2a-03f6ca174c80 None admin] RBAC: Adding query filter params (group.id=998d809837864c208becc5d92a608db5, role.id=2b2ea3ada01041ad941dd5b6721df5b2, scope.project.id=346276b0f40e4a0c84018861d282281c) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:10.668042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c667a46-10eb-4229-8b2a-03f6ca174c80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:10.669901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c667a46-10eb-4229-8b2a-03f6ca174c80 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:10.676820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 190/374] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 17 14:59:10 2022] GET /identity/v3/role_assignments?group.id=998d809837864c208becc5d92a608db5&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 260 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:10.677690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c667a46-10eb-4229-8b2a-03f6ca174c80 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:10.719118 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6dfcd-2ef1-4f8f-b991-ce7548035f8a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:10.732629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:10.763458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35207ae0-7720-43a2-a4e1-d0ee03a40077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:10.764436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207ae0-7720-43a2-a4e1-d0ee03a40077 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:10.764805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207ae0-7720-43a2-a4e1-d0ee03a40077 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:10.765604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207ae0-7720-43a2-a4e1-d0ee03a40077 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:10.767326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35207ae0-7720-43a2-a4e1-d0ee03a40077 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:10.768349 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35207ae0-7720-43a2-a4e1-d0ee03a40077 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:10.771524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 185/375] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:10 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:10.772338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bfe25-7c9b-455c-81a5-31b5606afb80 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:10.772673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bfe25-7c9b-455c-81a5-31b5606afb80 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:10.772952 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bfe25-7c9b-455c-81a5-31b5606afb80 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:10.774517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 186/376] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:10.777528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bfe25-7c9b-455c-81a5-31b5606afb80 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:10.813463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c667a46-10eb-4229-8b2a-03f6ca174c80 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:10.825427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:10.866906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de6567-3747-411d-844a-4fe2f74d7f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:10.868242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de6567-3747-411d-844a-4fe2f74d7f8e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:10.868534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de6567-3747-411d-844a-4fe2f74d7f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:10.869261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de6567-3747-411d-844a-4fe2f74d7f8e None admin] PATH_INFO: `/v3/projects/2862ed4e06e54fce9d45a21ed40f7a44` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:10.871232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de6567-3747-411d-844a-4fe2f74d7f8e None admin] RBAC: Authorizing `identity:get_project(project_id=2862ed4e06e54fce9d45a21ed40f7a44)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:10.873473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de6567-3747-411d-844a-4fe2f74d7f8e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:10.876274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 191/377] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:10 2022] GET /identity/v3/projects/2862ed4e06e54fce9d45a21ed40f7a44 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:10.877734 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8cac-af31-4c50-822b-2f683ed049bd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:10.878139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8cac-af31-4c50-822b-2f683ed049bd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:10.878490 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8cac-af31-4c50-822b-2f683ed049bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:10.901278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5d5a8cac-af31-4c50-822b-2f683ed049bd None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:10.903738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5d5a8cac-af31-4c50-822b-2f683ed049bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:10.949761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bfe25-7c9b-455c-81a5-31b5606afb80 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:10.997427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b456ae-f669-41df-b604-2ec3adb3f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:10.998735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b456ae-f669-41df-b604-2ec3adb3f91a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:10.999095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b456ae-f669-41df-b604-2ec3adb3f91a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:10.999448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b456ae-f669-41df-b604-2ec3adb3f91a None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:11.001342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b456ae-f669-41df-b604-2ec3adb3f91a None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:11.003383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b456ae-f669-41df-b604-2ec3adb3f91a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:11.006738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 187/378] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:10 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:11.007795 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b456ae-f669-41df-b604-2ec3adb3f91a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:11.015967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 192/379] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:11.017788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a8cac-af31-4c50-822b-2f683ed049bd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:11.072414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:11.176858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a8cac-af31-4c50-822b-2f683ed049bd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:11.177178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b456ae-f669-41df-b604-2ec3adb3f91a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:11.186415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:11.236895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d947e5-4966-4558-a3a0-c94313026fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:11.238287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357bf8f-5e67-488c-a60d-5857e5f5d8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:11.239195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d947e5-4966-4558-a3a0-c94313026fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:11.240202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357bf8f-5e67-488c-a60d-5857e5f5d8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:11.240621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d947e5-4966-4558-a3a0-c94313026fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:11.241027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d947e5-4966-4558-a3a0-c94313026fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:11.241532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357bf8f-5e67-488c-a60d-5857e5f5d8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:11.241799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357bf8f-5e67-488c-a60d-5857e5f5d8c6 None admin] PATH_INFO: `/v3/groups/4ae01027723a43729f77746b6e25a2aa` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:11.243175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d947e5-4966-4558-a3a0-c94313026fd4 None admin] RBAC: Adding query filter params (group.id=998d809837864c208becc5d92a608db5, role.id=f36f89c30b0a4c38900202ea156ed20e, scope.project.id=346276b0f40e4a0c84018861d282281c) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:11.243484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d947e5-4966-4558-a3a0-c94313026fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:11.245353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d947e5-4966-4558-a3a0-c94313026fd4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:11.250967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357bf8f-5e67-488c-a60d-5857e5f5d8c6 None admin] RBAC: Authorizing `identity:get_group(group_id=4ae01027723a43729f77746b6e25a2aa)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:11.252712 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357bf8f-5e67-488c-a60d-5857e5f5d8c6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:11.252942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 193/380] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 17 14:59:11 2022] GET /identity/v3/role_assignments?group.id=998d809837864c208becc5d92a608db5&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=f36f89c30b0a4c38900202ea156ed20e => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:11.253950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d947e5-4966-4558-a3a0-c94313026fd4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:11.260251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 188/381] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:11 2022] GET /identity/v3/groups/4ae01027723a43729f77746b6e25a2aa => generated 229 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:11.261882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357bf8f-5e67-488c-a60d-5857e5f5d8c6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:11.395704 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d947e5-4966-4558-a3a0-c94313026fd4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:11.404701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357bf8f-5e67-488c-a60d-5857e5f5d8c6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:11.416477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:11.447429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50447d-8014-4d6b-9782-d3d8ffa8b510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:11.449474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50447d-8014-4d6b-9782-d3d8ffa8b510 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:11.450238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50447d-8014-4d6b-9782-d3d8ffa8b510 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:11.450660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50447d-8014-4d6b-9782-d3d8ffa8b510 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:11.467562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7acd7-776c-4cc6-a7a1-9996b9356795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:11.468718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7acd7-776c-4cc6-a7a1-9996b9356795 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:11.470832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7acd7-776c-4cc6-a7a1-9996b9356795 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:11.471283 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7acd7-776c-4cc6-a7a1-9996b9356795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:11.472294 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7acd7-776c-4cc6-a7a1-9996b9356795 None admin] RBAC: Adding query filter params (group.id=4ae01027723a43729f77746b6e25a2aa, role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=2862ed4e06e54fce9d45a21ed40f7a44) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:11.472873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7acd7-776c-4cc6-a7a1-9996b9356795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:11.475573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7acd7-776c-4cc6-a7a1-9996b9356795 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:11.481861 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50447d-8014-4d6b-9782-d3d8ffa8b510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4a50447d-8014-4d6b-9782-d3d8ffa8b510 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:11.490129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:11.491274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:11.492220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:11.498677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 189/382] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 17 14:59:11 2022] GET /identity/v3/role_assignments?group.id=4ae01027723a43729f77746b6e25a2aa&scope.project.id=2862ed4e06e54fce9d45a21ed40f7a44&role.id=8a6fe5045159487aa0119348cfe94387 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:11.500434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 194/383] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:11.510550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7acd7-776c-4cc6-a7a1-9996b9356795 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:11.637186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7acd7-776c-4cc6-a7a1-9996b9356795 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:11.688744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5369af-fdce-4ae1-b9e9-bcd52113ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:11.689706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5369af-fdce-4ae1-b9e9-bcd52113ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:11.689984 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5369af-fdce-4ae1-b9e9-bcd52113ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:11.690254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5369af-fdce-4ae1-b9e9-bcd52113ccc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:11.691000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5369af-fdce-4ae1-b9e9-bcd52113ccc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:11.691302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5369af-fdce-4ae1-b9e9-bcd52113ccc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:11.692679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5369af-fdce-4ae1-b9e9-bcd52113ccc0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:11.703007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 190/384] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:11.708158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50447d-8014-4d6b-9782-d3d8ffa8b510 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:11.749035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:11.847625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50447d-8014-4d6b-9782-d3d8ffa8b510 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:11.900516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186db68e-b1f2-42bb-9c1b-67e75c4a1943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:11.901696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186db68e-b1f2-42bb-9c1b-67e75c4a1943 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:11.901978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186db68e-b1f2-42bb-9c1b-67e75c4a1943 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:11.902263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186db68e-b1f2-42bb-9c1b-67e75c4a1943 None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:11.906228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186db68e-b1f2-42bb-9c1b-67e75c4a1943 None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:11.907803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186db68e-b1f2-42bb-9c1b-67e75c4a1943 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:11.909988 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 195/385] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:11 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:11.916038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5369af-fdce-4ae1-b9e9-bcd52113ccc0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:11.958961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:11.970673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a918f-a84e-49ae-9328-17665a3afbe3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:11.970966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a918f-a84e-49ae-9328-17665a3afbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:11.971223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a918f-a84e-49ae-9328-17665a3afbe3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:11.972817 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 196/386] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:59:11.978771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbdcd6-e6b8-47bf-9d5c-66797abfea14 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:11.979114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbdcd6-e6b8-47bf-9d5c-66797abfea14 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:11.979815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbdcd6-e6b8-47bf-9d5c-66797abfea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:12.010520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a6cbdcd6-e6b8-47bf-9d5c-66797abfea14 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:12.012589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a6cbdcd6-e6b8-47bf-9d5c-66797abfea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:12.069029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5369af-fdce-4ae1-b9e9-bcd52113ccc0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:12.121969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a3fd8-650a-4fe3-8fa3-4a66a3ff40f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:12.122960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a3fd8-650a-4fe3-8fa3-4a66a3ff40f4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:12.123244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a3fd8-650a-4fe3-8fa3-4a66a3ff40f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:12.123523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a3fd8-650a-4fe3-8fa3-4a66a3ff40f4 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:12.123783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 197/387] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:12.124779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a3fd8-650a-4fe3-8fa3-4a66a3ff40f4 None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:12.128232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a3fd8-650a-4fe3-8fa3-4a66a3ff40f4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:12.128232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 191/388] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:11 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:12.133508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbdcd6-e6b8-47bf-9d5c-66797abfea14 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:12.146121 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a3fd8-650a-4fe3-8fa3-4a66a3ff40f4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:12.163560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:12.239558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbdcd6-e6b8-47bf-9d5c-66797abfea14 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:12.276801 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02425fd7-e560-4ffb-9010-66fff3b308a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:12.278189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02425fd7-e560-4ffb-9010-66fff3b308a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:12.278649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02425fd7-e560-4ffb-9010-66fff3b308a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:12.279101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02425fd7-e560-4ffb-9010-66fff3b308a4 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009/groups/998d809837864c208becc5d92a608db5/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:12.281505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02425fd7-e560-4ffb-9010-66fff3b308a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=df2e2d29dd144c198fac526f80a50009, group_id=998d809837864c208becc5d92a608db5, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:12.283192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02425fd7-e560-4ffb-9010-66fff3b308a4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:12.299056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 198/389] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Jun 17 14:59:12 2022] PUT /identity/v3/projects/df2e2d29dd144c198fac526f80a50009/groups/998d809837864c208becc5d92a608db5/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:12.372063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:12.374948 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a3fd8-650a-4fe3-8fa3-4a66a3ff40f4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:12.431164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070d13a-df99-44cb-b7c7-b181089e5899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:12.432451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d13a-df99-44cb-b7c7-b181089e5899 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:12.432999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d13a-df99-44cb-b7c7-b181089e5899 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:12.433550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d13a-df99-44cb-b7c7-b181089e5899 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:12.455737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070d13a-df99-44cb-b7c7-b181089e5899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5070d13a-df99-44cb-b7c7-b181089e5899 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:12.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:12.466181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:12.467076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:12.472659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 192/390] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:59:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:12.479453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02425fd7-e560-4ffb-9010-66fff3b308a4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:12.599104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:12.613421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02425fd7-e560-4ffb-9010-66fff3b308a4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:12.656461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ef27-5166-4d03-ad45-e98e5f8909bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:12.657254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ef27-5166-4d03-ad45-e98e5f8909bf None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:12.657540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ef27-5166-4d03-ad45-e98e5f8909bf None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:12.657817 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ef27-5166-4d03-ad45-e98e5f8909bf None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:12.658642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ef27-5166-4d03-ad45-e98e5f8909bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:12.658955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ef27-5166-4d03-ad45-e98e5f8909bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:12.660475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ef27-5166-4d03-ad45-e98e5f8909bf None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:12.670917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 199/391] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:12.676356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070d13a-df99-44cb-b7c7-b181089e5899 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:12.863785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070d13a-df99-44cb-b7c7-b181089e5899 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:12.917659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027ae78-9b8c-4fd1-90e3-18e628c89a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:12.918588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027ae78-9b8c-4fd1-90e3-18e628c89a4b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:12.918878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027ae78-9b8c-4fd1-90e3-18e628c89a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:12.919159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027ae78-9b8c-4fd1-90e3-18e628c89a4b None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:12.920369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027ae78-9b8c-4fd1-90e3-18e628c89a4b None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:12.921925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027ae78-9b8c-4fd1-90e3-18e628c89a4b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:12.923731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 193/392] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:12 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:12.929652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ef27-5166-4d03-ad45-e98e5f8909bf None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:13.079670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ef27-5166-4d03-ad45-e98e5f8909bf None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:13.123685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877627b8-704b-4a29-b61a-757fff5cfd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:13.124486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877627b8-704b-4a29-b61a-757fff5cfd15 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:13.124769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877627b8-704b-4a29-b61a-757fff5cfd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:13.125107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877627b8-704b-4a29-b61a-757fff5cfd15 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:13.126509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877627b8-704b-4a29-b61a-757fff5cfd15 None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:13.127989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877627b8-704b-4a29-b61a-757fff5cfd15 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:13.130220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 200/393] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:12 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:13.138691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027ae78-9b8c-4fd1-90e3-18e628c89a4b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:13.181859 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:13.279664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027ae78-9b8c-4fd1-90e3-18e628c89a4b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:13.323292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47ef84-f26b-4045-a200-78eefe50398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:13.324297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ef84-f26b-4045-a200-78eefe50398a None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:13.324694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ef84-f26b-4045-a200-78eefe50398a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:13.325036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ef84-f26b-4045-a200-78eefe50398a None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009/groups/998d809837864c208becc5d92a608db5/roles/f36f89c30b0a4c38900202ea156ed20e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:13.327908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47ef84-f26b-4045-a200-78eefe50398a None admin] RBAC: Authorizing `identity:create_grant(project_id=df2e2d29dd144c198fac526f80a50009, group_id=998d809837864c208becc5d92a608db5, role_id=f36f89c30b0a4c38900202ea156ed20e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:13.329607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47ef84-f26b-4045-a200-78eefe50398a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:13.349811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 194/394] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Jun 17 14:59:13 2022] PUT /identity/v3/projects/df2e2d29dd144c198fac526f80a50009/groups/998d809837864c208becc5d92a608db5/roles/f36f89c30b0a4c38900202ea156ed20e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:13.423375 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45befd7-7889-4da1-9877-8db357581a53 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:13.423572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45befd7-7889-4da1-9877-8db357581a53 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:13.423848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45befd7-7889-4da1-9877-8db357581a53 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:13.425284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 201/395] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:13.431819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703d77b-3f5d-40df-9910-615b720709de None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:13.432175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703d77b-3f5d-40df-9910-615b720709de None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:13.432621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703d77b-3f5d-40df-9910-615b720709de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:13.470551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4703d77b-3f5d-40df-9910-615b720709de None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:13.471800 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4703d77b-3f5d-40df-9910-615b720709de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:13.569151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 195/396] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:13.593418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45befd7-7889-4da1-9877-8db357581a53 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:13.620030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:13.738197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45befd7-7889-4da1-9877-8db357581a53 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:13.786231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ac8b-1ba8-4f54-bb39-463662f6e327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:13.787081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ac8b-1ba8-4f54-bb39-463662f6e327 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:13.787363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ac8b-1ba8-4f54-bb39-463662f6e327 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:13.787641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ac8b-1ba8-4f54-bb39-463662f6e327 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:13.805457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269ac8b-1ba8-4f54-bb39-463662f6e327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e269ac8b-1ba8-4f54-bb39-463662f6e327 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:13.813992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:13.814948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:13.815729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:13.820640 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 202/397] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:13.822224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703d77b-3f5d-40df-9910-615b720709de None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:13.851590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:13.950086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703d77b-3f5d-40df-9910-615b720709de None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:14.000000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591663b-60c6-4c56-b523-dfd509d2d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:14.000603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591663b-60c6-4c56-b523-dfd509d2d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:14.000880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591663b-60c6-4c56-b523-dfd509d2d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:14.001154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591663b-60c6-4c56-b523-dfd509d2d5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:14.001949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591663b-60c6-4c56-b523-dfd509d2d5e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:14.002260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591663b-60c6-4c56-b523-dfd509d2d5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:14.003705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591663b-60c6-4c56-b523-dfd509d2d5e8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:14.013629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 196/398] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:14.021446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ac8b-1ba8-4f54-bb39-463662f6e327 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:14.136143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:14.172009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ac8b-1ba8-4f54-bb39-463662f6e327 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:14.222782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec980cc-f1c2-4743-a530-c448ab7ecf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:14.223693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec980cc-f1c2-4743-a530-c448ab7ecf44 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:14.223980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec980cc-f1c2-4743-a530-c448ab7ecf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:14.224254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec980cc-f1c2-4743-a530-c448ab7ecf44 None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:14.227530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec980cc-f1c2-4743-a530-c448ab7ecf44 None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:14.229193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec980cc-f1c2-4743-a530-c448ab7ecf44 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:14.231771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 203/399] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:14 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:14.238190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591663b-60c6-4c56-b523-dfd509d2d5e8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:14.323210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eb99f-9825-4bc5-b2b4-d14b1608961b None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:14.324080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eb99f-9825-4bc5-b2b4-d14b1608961b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:14.324600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eb99f-9825-4bc5-b2b4-d14b1608961b None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:14.331034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 204/400] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:14.332804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238cff7-b7d7-466e-a4a8-6a36ae0582e1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:14.333323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238cff7-b7d7-466e-a4a8-6a36ae0582e1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:14.333800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238cff7-b7d7-466e-a4a8-6a36ae0582e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:14.341062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:14.357828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591663b-60c6-4c56-b523-dfd509d2d5e8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:14.369994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3238cff7-b7d7-466e-a4a8-6a36ae0582e1 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:14.371660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3238cff7-b7d7-466e-a4a8-6a36ae0582e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:14.395114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f193a1e-0c68-42b0-bc1f-531327d7c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:14.396353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f193a1e-0c68-42b0-bc1f-531327d7c557 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:14.396808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f193a1e-0c68-42b0-bc1f-531327d7c557 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:14.397295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f193a1e-0c68-42b0-bc1f-531327d7c557 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:14.403156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f193a1e-0c68-42b0-bc1f-531327d7c557 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:14.405172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f193a1e-0c68-42b0-bc1f-531327d7c557 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:14.410355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 197/401] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:14 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:14.415978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f193a1e-0c68-42b0-bc1f-531327d7c557 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:14.534595 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 205/402] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:14.537392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825adb8-d8d6-41ee-b345-e3346f6d6263 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:14.537895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825adb8-d8d6-41ee-b345-e3346f6d6263 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:14.539022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825adb8-d8d6-41ee-b345-e3346f6d6263 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:14.541648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 206/403] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:14.547281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086ebc-81a5-4174-a2db-e30b2a72a29b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:14.548016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086ebc-81a5-4174-a2db-e30b2a72a29b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:14.548447 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086ebc-81a5-4174-a2db-e30b2a72a29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:14.577130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f9086ebc-81a5-4174-a2db-e30b2a72a29b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:14.580034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f9086ebc-81a5-4174-a2db-e30b2a72a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:14.608251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f193a1e-0c68-42b0-bc1f-531327d7c557 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:14.660446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88fbe1-b8d2-4d3f-a4dd-d1c04e87320e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:14.661618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88fbe1-b8d2-4d3f-a4dd-d1c04e87320e None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:14.662070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88fbe1-b8d2-4d3f-a4dd-d1c04e87320e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:14.662509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88fbe1-b8d2-4d3f-a4dd-d1c04e87320e None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c/groups/998d809837864c208becc5d92a608db5/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:14.664703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88fbe1-b8d2-4d3f-a4dd-d1c04e87320e None admin] RBAC: Authorizing `identity:create_grant(project_id=346276b0f40e4a0c84018861d282281c, group_id=998d809837864c208becc5d92a608db5, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:14.666365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88fbe1-b8d2-4d3f-a4dd-d1c04e87320e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:14.687331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 198/405] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Jun 17 14:59:14 2022] PUT /identity/v3/projects/346276b0f40e4a0c84018861d282281c/groups/998d809837864c208becc5d92a608db5/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:14.688702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88fbe1-b8d2-4d3f-a4dd-d1c04e87320e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:14.693620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 207/405] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:14.712693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:14.715070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9086ebc-81a5-4174-a2db-e30b2a72a29b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:14.728830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:14.920105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9086ebc-81a5-4174-a2db-e30b2a72a29b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:14.959719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88fbe1-b8d2-4d3f-a4dd-d1c04e87320e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:14.969093 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb02a-0fb6-4e52-a1c5-bda2823134ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:14.970434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb02a-0fb6-4e52-a1c5-bda2823134ef None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:14.970926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb02a-0fb6-4e52-a1c5-bda2823134ef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:14.971407 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb02a-0fb6-4e52-a1c5-bda2823134ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:14.997473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcb02a-0fb6-4e52-a1c5-bda2823134ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e1bcb02a-0fb6-4e52-a1c5-bda2823134ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:15.007022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:15.008227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:15.010318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 208/406] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:15.013755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aa383-6bac-44f0-8571-45c678f3acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:15.015299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb02a-0fb6-4e52-a1c5-bda2823134ef None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:15.016021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aa383-6bac-44f0-8571-45c678f3acb0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.016507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aa383-6bac-44f0-8571-45c678f3acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.017500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aa383-6bac-44f0-8571-45c678f3acb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.046277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aa383-6bac-44f0-8571-45c678f3acb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-645aa383-6bac-44f0-8571-45c678f3acb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:15.069416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:15.070455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:15.071278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:15.074637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 199/407] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:59:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:15.082510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aa383-6bac-44f0-8571-45c678f3acb0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:15.117250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:15.179396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb02a-0fb6-4e52-a1c5-bda2823134ef None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:15.216198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:15.231149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb85e86-f113-4b28-9274-a360184c0e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:15.232107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85e86-f113-4b28-9274-a360184c0e85 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.233107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85e86-f113-4b28-9274-a360184c0e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.233567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85e86-f113-4b28-9274-a360184c0e85 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.234461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb85e86-f113-4b28-9274-a360184c0e85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:15.235254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb85e86-f113-4b28-9274-a360184c0e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:15.237138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb85e86-f113-4b28-9274-a360184c0e85 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:15.250644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 209/408] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:15.252331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d7840-4955-47e2-ab1e-feb1f1d583db None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.252756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d7840-4955-47e2-ab1e-feb1f1d583db None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.253166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d7840-4955-47e2-ab1e-feb1f1d583db None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.258959 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 210/409] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:15.262198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d7840-4955-47e2-ab1e-feb1f1d583db None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:15.283431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aa383-6bac-44f0-8571-45c678f3acb0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:15.337107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da888cb-4977-4eb9-ad56-62cd592d9901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:15.338490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da888cb-4977-4eb9-ad56-62cd592d9901 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.338980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da888cb-4977-4eb9-ad56-62cd592d9901 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.339475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da888cb-4977-4eb9-ad56-62cd592d9901 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.340547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da888cb-4977-4eb9-ad56-62cd592d9901 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:15.341045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da888cb-4977-4eb9-ad56-62cd592d9901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:15.342956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da888cb-4977-4eb9-ad56-62cd592d9901 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:15.357843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 200/410] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:15.359764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b6b6-3d14-4d07-ae7b-a9d0bbce602e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.360318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b6b6-3d14-4d07-ae7b-a9d0bbce602e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.360840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b6b6-3d14-4d07-ae7b-a9d0bbce602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.379299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0666b6b6-3d14-4d07-ae7b-a9d0bbce602e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:15.380884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0666b6b6-3d14-4d07-ae7b-a9d0bbce602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:15.399351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d7840-4955-47e2-ab1e-feb1f1d583db None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:15.433610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:15.442643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eec0e7-26dc-48ae-abb2-fd461a60806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:15.443574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eec0e7-26dc-48ae-abb2-fd461a60806a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.443854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eec0e7-26dc-48ae-abb2-fd461a60806a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.444179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eec0e7-26dc-48ae-abb2-fd461a60806a None admin] PATH_INFO: `/v3/groups/4ae01027723a43729f77746b6e25a2aa` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.445548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eec0e7-26dc-48ae-abb2-fd461a60806a None admin] RBAC: Authorizing `identity:get_group(group_id=4ae01027723a43729f77746b6e25a2aa)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:15.447216 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eec0e7-26dc-48ae-abb2-fd461a60806a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:15.450477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 211/411] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:15 2022] GET /identity/v3/groups/4ae01027723a43729f77746b6e25a2aa => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:15.456014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eec0e7-26dc-48ae-abb2-fd461a60806a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:15.472933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 201/412] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:15.474461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666b6b6-3d14-4d07-ae7b-a9d0bbce602e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:15.558580 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:15.574561 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eec0e7-26dc-48ae-abb2-fd461a60806a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:15.604649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666b6b6-3d14-4d07-ae7b-a9d0bbce602e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:15.612753 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7800ed8-916b-40de-8e36-1e3f1765abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:15.613666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800ed8-916b-40de-8e36-1e3f1765abcc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.613954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800ed8-916b-40de-8e36-1e3f1765abcc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.614229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800ed8-916b-40de-8e36-1e3f1765abcc None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.615491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7800ed8-916b-40de-8e36-1e3f1765abcc None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:15.616960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7800ed8-916b-40de-8e36-1e3f1765abcc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:15.620345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 212/413] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:15 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:15.620345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7800ed8-916b-40de-8e36-1e3f1765abcc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:15.651383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed325e95-c001-4f25-a891-cf450ca3c13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:15.652630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed325e95-c001-4f25-a891-cf450ca3c13c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.653101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed325e95-c001-4f25-a891-cf450ca3c13c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.653638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed325e95-c001-4f25-a891-cf450ca3c13c None admin] PATH_INFO: `/v3/projects/2862ed4e06e54fce9d45a21ed40f7a44` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.657413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed325e95-c001-4f25-a891-cf450ca3c13c None admin] RBAC: Authorizing `identity:get_project(project_id=2862ed4e06e54fce9d45a21ed40f7a44)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:15.658036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed325e95-c001-4f25-a891-cf450ca3c13c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:15.665532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 202/414] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:15 2022] GET /identity/v3/projects/2862ed4e06e54fce9d45a21ed40f7a44 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:15.665532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed325e95-c001-4f25-a891-cf450ca3c13c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:15.697946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:15.742077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7800ed8-916b-40de-8e36-1e3f1765abcc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:15.781595 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9ee9a-bc14-4b8d-b304-b3091899b192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:15.786295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed325e95-c001-4f25-a891-cf450ca3c13c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:15.793492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9ee9a-bc14-4b8d-b304-b3091899b192 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.793715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9ee9a-bc14-4b8d-b304-b3091899b192 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.793924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9ee9a-bc14-4b8d-b304-b3091899b192 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.806032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9ee9a-bc14-4b8d-b304-b3091899b192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-04e9ee9a-bc14-4b8d-b304-b3091899b192 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:15.814618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:15.815580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:15.816815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:15.820835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 213/415] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:15.821710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9ee9a-bc14-4b8d-b304-b3091899b192 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:15.823005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:15.833110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413eaff-a259-41af-876d-7a744f6629bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:15.834458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413eaff-a259-41af-876d-7a744f6629bd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.834941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413eaff-a259-41af-876d-7a744f6629bd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.835437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413eaff-a259-41af-876d-7a744f6629bd None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.836999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413eaff-a259-41af-876d-7a744f6629bd None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:15.838895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413eaff-a259-41af-876d-7a744f6629bd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:15.845357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 203/416] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:15 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:15.846687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413eaff-a259-41af-876d-7a744f6629bd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:15.934240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9ee9a-bc14-4b8d-b304-b3091899b192 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:15.961466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:15.964601 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413eaff-a259-41af-876d-7a744f6629bd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:15.984956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24ddfe-ef6d-499b-9050-fdf6cc20c86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:15.986764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24ddfe-ef6d-499b-9050-fdf6cc20c86c None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:15.987692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24ddfe-ef6d-499b-9050-fdf6cc20c86c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:15.988234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24ddfe-ef6d-499b-9050-fdf6cc20c86c None admin] PATH_INFO: `/v3/projects/2862ed4e06e54fce9d45a21ed40f7a44/groups/4ae01027723a43729f77746b6e25a2aa/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:15.991470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24ddfe-ef6d-499b-9050-fdf6cc20c86c None admin] RBAC: Authorizing `identity:create_grant(project_id=2862ed4e06e54fce9d45a21ed40f7a44, group_id=4ae01027723a43729f77746b6e25a2aa, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:15.994325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24ddfe-ef6d-499b-9050-fdf6cc20c86c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:16.015878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 214/417] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Jun 17 14:59:15 2022] PUT /identity/v3/projects/2862ed4e06e54fce9d45a21ed40f7a44/groups/4ae01027723a43729f77746b6e25a2aa/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:16.017335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24ddfe-ef6d-499b-9050-fdf6cc20c86c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:16.022474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091b43a-d1b5-4605-88b4-cddb6c56908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:16.022706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091b43a-d1b5-4605-88b4-cddb6c56908d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:16.022862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091b43a-d1b5-4605-88b4-cddb6c56908d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:16.023297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091b43a-d1b5-4605-88b4-cddb6c56908d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:16.024251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091b43a-d1b5-4605-88b4-cddb6c56908d None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:16.024682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091b43a-d1b5-4605-88b4-cddb6c56908d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:16.030473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091b43a-d1b5-4605-88b4-cddb6c56908d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:16.049118 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 204/418] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:16.054877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091b43a-d1b5-4605-88b4-cddb6c56908d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:16.162081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:16.168607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24ddfe-ef6d-499b-9050-fdf6cc20c86c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:16.211322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79682ec-2f9f-4194-91fe-8aa041f3fcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:16.212345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79682ec-2f9f-4194-91fe-8aa041f3fcc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:16.212709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79682ec-2f9f-4194-91fe-8aa041f3fcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:16.212873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79682ec-2f9f-4194-91fe-8aa041f3fcc3 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c/groups/998d809837864c208becc5d92a608db5/roles/f36f89c30b0a4c38900202ea156ed20e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:16.215289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79682ec-2f9f-4194-91fe-8aa041f3fcc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=346276b0f40e4a0c84018861d282281c, group_id=998d809837864c208becc5d92a608db5, role_id=f36f89c30b0a4c38900202ea156ed20e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:16.216770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79682ec-2f9f-4194-91fe-8aa041f3fcc3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:16.217471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091b43a-d1b5-4605-88b4-cddb6c56908d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:16.235043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 215/419] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Jun 17 14:59:16 2022] PUT /identity/v3/projects/346276b0f40e4a0c84018861d282281c/groups/998d809837864c208becc5d92a608db5/roles/f36f89c30b0a4c38900202ea156ed20e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:16.238250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f361b8-757f-4987-b739-c20b9243c2c2 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:16.238538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f361b8-757f-4987-b739-c20b9243c2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:16.238815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f361b8-757f-4987-b739-c20b9243c2c2 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:16.240388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 216/420] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:16.246060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd06f2-58e9-4b74-a801-066099f609a5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:16.246324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd06f2-58e9-4b74-a801-066099f609a5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:16.246608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd06f2-58e9-4b74-a801-066099f609a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:16.269118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f2bd06f2-58e9-4b74-a801-066099f609a5 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:16.270467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f2bd06f2-58e9-4b74-a801-066099f609a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:16.272471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672910e8-ffd5-4ce4-8d96-8ca04c506e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:16.273801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672910e8-ffd5-4ce4-8d96-8ca04c506e54 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:16.275324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672910e8-ffd5-4ce4-8d96-8ca04c506e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:16.275903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672910e8-ffd5-4ce4-8d96-8ca04c506e54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:16.352161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:16.386330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672910e8-ffd5-4ce4-8d96-8ca04c506e54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:16.389160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672910e8-ffd5-4ce4-8d96-8ca04c506e54 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:16.435761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 217/421] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:16.475214 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd06f2-58e9-4b74-a801-066099f609a5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:16.476557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:16.574046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 205/422] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:16.576582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672910e8-ffd5-4ce4-8d96-8ca04c506e54 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:16.684724 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672910e8-ffd5-4ce4-8d96-8ca04c506e54 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:16.700869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd06f2-58e9-4b74-a801-066099f609a5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:16.761125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7828-73e7-4a2a-9830-70db6c04389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:16.762096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7828-73e7-4a2a-9830-70db6c04389d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:16.762667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7828-73e7-4a2a-9830-70db6c04389d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:16.762947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7828-73e7-4a2a-9830-70db6c04389d None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:16.766641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f7828-73e7-4a2a-9830-70db6c04389d None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:16.768133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f7828-73e7-4a2a-9830-70db6c04389d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:16.769921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 206/423] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:16 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:16.776023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7828-73e7-4a2a-9830-70db6c04389d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:16.781572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b919eaa-b358-4c04-9d5f-9db43911a1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:16.782651 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919eaa-b358-4c04-9d5f-9db43911a1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:16.783064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919eaa-b358-4c04-9d5f-9db43911a1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:16.783447 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919eaa-b358-4c04-9d5f-9db43911a1e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:16.807264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b919eaa-b358-4c04-9d5f-9db43911a1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5b919eaa-b358-4c04-9d5f-9db43911a1e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:16.815575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:16.817317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:16.818828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:16.825232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 218/424] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:59:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:16.832973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b919eaa-b358-4c04-9d5f-9db43911a1e1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:16.851070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:16.906849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:17.019840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7828-73e7-4a2a-9830-70db6c04389d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:17.058104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b919eaa-b358-4c04-9d5f-9db43911a1e1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:17.107825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b2092-b6f0-4939-8071-7eaa93c8d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:17.108505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b2092-b6f0-4939-8071-7eaa93c8d79c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:17.108792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b2092-b6f0-4939-8071-7eaa93c8d79c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:17.109052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b2092-b6f0-4939-8071-7eaa93c8d79c None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:17.109982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b2092-b6f0-4939-8071-7eaa93c8d79c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:17.110295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b2092-b6f0-4939-8071-7eaa93c8d79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:17.111975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b2092-b6f0-4939-8071-7eaa93c8d79c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:17.125963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 219/425] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:17.132327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b2092-b6f0-4939-8071-7eaa93c8d79c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:17.154081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2029e-46c5-4308-b777-0f4bf0f1857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:17.155646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2029e-46c5-4308-b777-0f4bf0f1857f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:17.156139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2029e-46c5-4308-b777-0f4bf0f1857f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:17.156618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2029e-46c5-4308-b777-0f4bf0f1857f None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:17.159378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2029e-46c5-4308-b777-0f4bf0f1857f None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:17.161092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2029e-46c5-4308-b777-0f4bf0f1857f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:17.163363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 207/426] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:16 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:17.171132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2029e-46c5-4308-b777-0f4bf0f1857f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:17.298592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b2092-b6f0-4939-8071-7eaa93c8d79c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:17.300896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:17.340842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95b126-7a22-4c34-b712-48cc3930f89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:17.341771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95b126-7a22-4c34-b712-48cc3930f89b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:17.342280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95b126-7a22-4c34-b712-48cc3930f89b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:17.342688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95b126-7a22-4c34-b712-48cc3930f89b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:17.361935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:17.370506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2029e-46c5-4308-b777-0f4bf0f1857f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:17.417569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac5004-9ceb-4b2e-8a65-3b95e927186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:17.418952 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac5004-9ceb-4b2e-8a65-3b95e927186e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:17.419381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac5004-9ceb-4b2e-8a65-3b95e927186e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:17.419822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac5004-9ceb-4b2e-8a65-3b95e927186e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:17.420893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac5004-9ceb-4b2e-8a65-3b95e927186e None admin] RBAC: Adding query filter params (group.id=998d809837864c208becc5d92a608db5, role.id=2b2ea3ada01041ad941dd5b6721df5b2, scope.project.id=df2e2d29dd144c198fac526f80a50009) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:17.421368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac5004-9ceb-4b2e-8a65-3b95e927186e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:17.423060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac5004-9ceb-4b2e-8a65-3b95e927186e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:17.430832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 208/427] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 17 14:59:17 2022] GET /identity/v3/role_assignments?group.id=998d809837864c208becc5d92a608db5&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:17.439184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936bec4-375d-465b-b04f-06364a96007e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:17.439721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936bec4-375d-465b-b04f-06364a96007e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:17.439847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95b126-7a22-4c34-b712-48cc3930f89b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:17.440269 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936bec4-375d-465b-b04f-06364a96007e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:17.441424 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95b126-7a22-4c34-b712-48cc3930f89b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:17.442294 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 209/428] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:17.450623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221fc8-247f-45a0-92b3-6fe807a62494 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:17.451781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221fc8-247f-45a0-92b3-6fe807a62494 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:17.452522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221fc8-247f-45a0-92b3-6fe807a62494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:17.506507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-99221fc8-247f-45a0-92b3-6fe807a62494 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:17.507799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-99221fc8-247f-45a0-92b3-6fe807a62494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:17.581232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 220/429] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 14:59:17.581798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:17.586889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95b126-7a22-4c34-b712-48cc3930f89b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:17.696919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 210/430] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:17.727031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221fc8-247f-45a0-92b3-6fe807a62494 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:17.751862 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95b126-7a22-4c34-b712-48cc3930f89b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:17.796197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfed53-4f4a-4aa8-95e1-91d9c0c24d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:17.797281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfed53-4f4a-4aa8-95e1-91d9c0c24d16 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:17.797726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfed53-4f4a-4aa8-95e1-91d9c0c24d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:17.798155 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfed53-4f4a-4aa8-95e1-91d9c0c24d16 None admin] PATH_INFO: `/v3/projects/df2e2d29dd144c198fac526f80a50009` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:17.799563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfed53-4f4a-4aa8-95e1-91d9c0c24d16 None admin] RBAC: Authorizing `identity:get_project(project_id=df2e2d29dd144c198fac526f80a50009)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:17.801263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfed53-4f4a-4aa8-95e1-91d9c0c24d16 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:17.803352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 221/431] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:17 2022] GET /identity/v3/projects/df2e2d29dd144c198fac526f80a50009 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:17.812181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfed53-4f4a-4aa8-95e1-91d9c0c24d16 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:17.843037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:17.868953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221fc8-247f-45a0-92b3-6fe807a62494 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:17.908940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:17.912039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f26a6-1000-44b4-a80d-113412cedc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:17.913123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f26a6-1000-44b4-a80d-113412cedc1d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:17.914157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f26a6-1000-44b4-a80d-113412cedc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:17.914638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f26a6-1000-44b4-a80d-113412cedc1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:17.931338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f26a6-1000-44b4-a80d-113412cedc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ea0f26a6-1000-44b4-a80d-113412cedc1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:17.948186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:17.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 14:59:17.951810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:17.955963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfed53-4f4a-4aa8-95e1-91d9c0c24d16 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:17.956171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 211/432] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:17.961682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f26a6-1000-44b4-a80d-113412cedc1d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:18.000022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fd639-3b4b-42c2-aaee-84d492bd1e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:18.001074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fd639-3b4b-42c2-aaee-84d492bd1e31 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:18.001307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fd639-3b4b-42c2-aaee-84d492bd1e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:18.001588 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fd639-3b4b-42c2-aaee-84d492bd1e31 None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:18.002826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fd639-3b4b-42c2-aaee-84d492bd1e31 None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:18.004975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fd639-3b4b-42c2-aaee-84d492bd1e31 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:18.009702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 222/433] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:17 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:18.018807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fd639-3b4b-42c2-aaee-84d492bd1e31 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:18.092397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f26a6-1000-44b4-a80d-113412cedc1d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:18.133568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de968ca2-d199-432f-a12f-c4dd201908bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:18.134661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de968ca2-d199-432f-a12f-c4dd201908bb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:18.135232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de968ca2-d199-432f-a12f-c4dd201908bb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:18.135723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de968ca2-d199-432f-a12f-c4dd201908bb None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:18.136782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de968ca2-d199-432f-a12f-c4dd201908bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:18.137319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de968ca2-d199-432f-a12f-c4dd201908bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:18.139082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de968ca2-d199-432f-a12f-c4dd201908bb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:18.149964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 212/434] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 14:59:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:18.155433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de968ca2-d199-432f-a12f-c4dd201908bb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:18.167738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fd639-3b4b-42c2-aaee-84d492bd1e31 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:18.171874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:18.206478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:18.212374 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35049ef-6776-4d76-94d6-d6c770c17d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:18.213086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35049ef-6776-4d76-94d6-d6c770c17d04 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:18.213662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35049ef-6776-4d76-94d6-d6c770c17d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:18.214572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35049ef-6776-4d76-94d6-d6c770c17d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:18.215424 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35049ef-6776-4d76-94d6-d6c770c17d04 None admin] RBAC: Adding query filter params (group.id=998d809837864c208becc5d92a608db5, role.id=f36f89c30b0a4c38900202ea156ed20e, scope.project.id=df2e2d29dd144c198fac526f80a50009) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:18.215742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35049ef-6776-4d76-94d6-d6c770c17d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:18.217227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35049ef-6776-4d76-94d6-d6c770c17d04 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:18.225359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 223/435] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 17 14:59:18 2022] GET /identity/v3/role_assignments?group.id=998d809837864c208becc5d92a608db5&scope.project.id=df2e2d29dd144c198fac526f80a50009&role.id=f36f89c30b0a4c38900202ea156ed20e => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:18.300672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de968ca2-d199-432f-a12f-c4dd201908bb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:18.341302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf5926-7c26-4fe2-9d4f-e94f8810c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:18.342522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf5926-7c26-4fe2-9d4f-e94f8810c808 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:18.343027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf5926-7c26-4fe2-9d4f-e94f8810c808 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:18.343553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf5926-7c26-4fe2-9d4f-e94f8810c808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:18.424732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf5926-7c26-4fe2-9d4f-e94f8810c808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:18.426987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf5926-7c26-4fe2-9d4f-e94f8810c808 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:18.441687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:18.569777 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 213/436] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:18.577077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35049ef-6776-4d76-94d6-d6c770c17d04 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:18.695896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35049ef-6776-4d76-94d6-d6c770c17d04 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:18.758635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8abf95-27cc-4490-aa1e-dd174aa5d28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:18.760025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8abf95-27cc-4490-aa1e-dd174aa5d28e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:18.760602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8abf95-27cc-4490-aa1e-dd174aa5d28e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:18.761082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8abf95-27cc-4490-aa1e-dd174aa5d28e None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:18.762860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8abf95-27cc-4490-aa1e-dd174aa5d28e None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:18.764666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8abf95-27cc-4490-aa1e-dd174aa5d28e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:18.766790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 224/437] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:18 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:18.775488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf5926-7c26-4fe2-9d4f-e94f8810c808 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:18.821262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d959f0-577f-42fa-8f30-5b280f48ce2e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:18.821262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d959f0-577f-42fa-8f30-5b280f48ce2e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:18.821262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d959f0-577f-42fa-8f30-5b280f48ce2e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:18.821262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 225/438] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:59:18.827457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781beed-bbe3-46d5-bedc-9da9cca6f30a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:18.827741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781beed-bbe3-46d5-bedc-9da9cca6f30a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:18.828021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781beed-bbe3-46d5-bedc-9da9cca6f30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:18.857569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0781beed-bbe3-46d5-bedc-9da9cca6f30a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:18.858796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0781beed-bbe3-46d5-bedc-9da9cca6f30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:18.913630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf5926-7c26-4fe2-9d4f-e94f8810c808 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:18.927292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:18.942259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:18.952494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 226/439] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:18.953896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371f16-8b4c-44e2-91d2-02c72235e25a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:18.954181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371f16-8b4c-44e2-91d2-02c72235e25a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:18.954454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371f16-8b4c-44e2-91d2-02c72235e25a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:18.955319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178192-2571-473b-8759-f3cb89cf3108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:18.955933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 227/440] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:18.956189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178192-2571-473b-8759-f3cb89cf3108 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:18.956465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178192-2571-473b-8759-f3cb89cf3108 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:18.956738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178192-2571-473b-8759-f3cb89cf3108 None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:18.958009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178192-2571-473b-8759-f3cb89cf3108 None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:18.959493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178192-2571-473b-8759-f3cb89cf3108 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:18.961152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 214/441] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:18 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:18.961591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a85c7-f9fd-429b-805b-69bfbe1ebbe9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:18.961917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a85c7-f9fd-429b-805b-69bfbe1ebbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:18.962220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a85c7-f9fd-429b-805b-69bfbe1ebbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:18.967400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178192-2571-473b-8759-f3cb89cf3108 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:18.980031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-412a85c7-f9fd-429b-805b-69bfbe1ebbe9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:18.981280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-412a85c7-f9fd-429b-805b-69bfbe1ebbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:19.057535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 228/442] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:19.058845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a85c7-f9fd-429b-805b-69bfbe1ebbe9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:19.082574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178192-2571-473b-8759-f3cb89cf3108 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:19.126687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2078d8-164c-489e-abee-c3154049ef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:19.127378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2078d8-164c-489e-abee-c3154049ef34 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:19.127658 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2078d8-164c-489e-abee-c3154049ef34 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:19.127938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2078d8-164c-489e-abee-c3154049ef34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:19.129062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2078d8-164c-489e-abee-c3154049ef34 None admin] RBAC: Adding query filter params (group.id=998d809837864c208becc5d92a608db5, role.id=2b2ea3ada01041ad941dd5b6721df5b2, scope.project.id=346276b0f40e4a0c84018861d282281c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:19.129414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2078d8-164c-489e-abee-c3154049ef34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:19.130901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2078d8-164c-489e-abee-c3154049ef34 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:19.137624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 215/443] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 17 14:59:18 2022] GET /identity/v3/role_assignments?group.id=998d809837864c208becc5d92a608db5&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=2b2ea3ada01041ad941dd5b6721df5b2 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:19.138456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2078d8-164c-489e-abee-c3154049ef34 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:19.185567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a85c7-f9fd-429b-805b-69bfbe1ebbe9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:19.215410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:19.221467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:19.239267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33120910-3da0-4aba-917d-0698866f10ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:19.240486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33120910-3da0-4aba-917d-0698866f10ab None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:19.240911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33120910-3da0-4aba-917d-0698866f10ab None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:19.241372 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33120910-3da0-4aba-917d-0698866f10ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:19.259117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33120910-3da0-4aba-917d-0698866f10ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-33120910-3da0-4aba-917d-0698866f10ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:19.273729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:19.274810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:19.276454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:19.283683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 229/444] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:19.285825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33120910-3da0-4aba-917d-0698866f10ab None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:19.296131 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2078d8-164c-489e-abee-c3154049ef34 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:19.343555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257dcc0-a878-472c-9cae-2c40af63463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:19.344405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257dcc0-a878-472c-9cae-2c40af63463b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:19.344663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257dcc0-a878-472c-9cae-2c40af63463b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:19.344952 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257dcc0-a878-472c-9cae-2c40af63463b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:19.364295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257dcc0-a878-472c-9cae-2c40af63463b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2257dcc0-a878-472c-9cae-2c40af63463b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:19.371660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:19.372585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:19.373392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 216/445] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:59:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:19.381312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257dcc0-a878-472c-9cae-2c40af63463b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:19.428426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33120910-3da0-4aba-917d-0698866f10ab None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:19.476487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f596701-013f-4746-8c3b-415abca5abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:19.477718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f596701-013f-4746-8c3b-415abca5abab None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:19.478611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f596701-013f-4746-8c3b-415abca5abab None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:19.478611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f596701-013f-4746-8c3b-415abca5abab None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:19.479054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f596701-013f-4746-8c3b-415abca5abab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:19.479395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f596701-013f-4746-8c3b-415abca5abab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:19.481012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f596701-013f-4746-8c3b-415abca5abab None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:19.491681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 230/446] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:19.497869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f596701-013f-4746-8c3b-415abca5abab None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:19.531192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257dcc0-a878-472c-9cae-2c40af63463b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:19.533909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:19.563261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:19.590484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b1557-9c6b-49b6-bedb-8ca49a6ca3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:19.591502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b1557-9c6b-49b6-bedb-8ca49a6ca3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:19.591781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b1557-9c6b-49b6-bedb-8ca49a6ca3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:19.592055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b1557-9c6b-49b6-bedb-8ca49a6ca3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:19.592816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b1557-9c6b-49b6-bedb-8ca49a6ca3e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:19.593132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b1557-9c6b-49b6-bedb-8ca49a6ca3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:19.594565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b1557-9c6b-49b6-bedb-8ca49a6ca3e5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:19.605957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 217/447] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:19.611315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b1557-9c6b-49b6-bedb-8ca49a6ca3e5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:19.630911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f596701-013f-4746-8c3b-415abca5abab None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:19.673062 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f49f0-941d-4f6f-a97b-bc15747979de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:19.673762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f49f0-941d-4f6f-a97b-bc15747979de None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:19.674041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f49f0-941d-4f6f-a97b-bc15747979de None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:19.674313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f49f0-941d-4f6f-a97b-bc15747979de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:19.728247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b1557-9c6b-49b6-bedb-8ca49a6ca3e5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:19.761516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f49f0-941d-4f6f-a97b-bc15747979de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:19.762954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f49f0-941d-4f6f-a97b-bc15747979de None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:19.765670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05a603-ba14-4155-b1bd-f85460d66475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:19.766312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a603-ba14-4155-b1bd-f85460d66475 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:19.766595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a603-ba14-4155-b1bd-f85460d66475 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:19.766871 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a603-ba14-4155-b1bd-f85460d66475 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:19.810980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:19.818696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:19.851297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05a603-ba14-4155-b1bd-f85460d66475 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:19.852764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05a603-ba14-4155-b1bd-f85460d66475 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:19.879050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 231/448] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:19.884707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f49f0-941d-4f6f-a97b-bc15747979de None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:19.972651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 218/449] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 14:59:19.978672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05a603-ba14-4155-b1bd-f85460d66475 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:20.000403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f49f0-941d-4f6f-a97b-bc15747979de None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:20.043088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed070eb-5ee9-4c14-b435-c0d29ec7c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:20.044049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed070eb-5ee9-4c14-b435-c0d29ec7c822 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:20.044323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed070eb-5ee9-4c14-b435-c0d29ec7c822 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:20.044594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed070eb-5ee9-4c14-b435-c0d29ec7c822 None admin] PATH_INFO: `/v3/projects/2862ed4e06e54fce9d45a21ed40f7a44` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:20.045990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed070eb-5ee9-4c14-b435-c0d29ec7c822 None admin] RBAC: Authorizing `identity:get_project(project_id=2862ed4e06e54fce9d45a21ed40f7a44)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:20.047512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed070eb-5ee9-4c14-b435-c0d29ec7c822 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:20.049881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 232/450] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:19 2022] GET /identity/v3/projects/2862ed4e06e54fce9d45a21ed40f7a44 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:20.054780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:20.058450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed070eb-5ee9-4c14-b435-c0d29ec7c822 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:20.074832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:20.099870 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05a603-ba14-4155-b1bd-f85460d66475 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:20.135616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3b66-8741-4f24-aebc-881005332cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:20.136650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3b66-8741-4f24-aebc-881005332cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:20.136943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3b66-8741-4f24-aebc-881005332cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:20.137244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3b66-8741-4f24-aebc-881005332cf0 None admin] PATH_INFO: `/v3/projects/346276b0f40e4a0c84018861d282281c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:20.138568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e3b66-8741-4f24-aebc-881005332cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=346276b0f40e4a0c84018861d282281c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:20.140074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e3b66-8741-4f24-aebc-881005332cf0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:20.141884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 219/451] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 14:59:19 2022] GET /identity/v3/projects/346276b0f40e4a0c84018861d282281c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:20.147881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3b66-8741-4f24-aebc-881005332cf0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:20.167160 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed070eb-5ee9-4c14-b435-c0d29ec7c822 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:20.204712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1ac94-7ad2-4e6f-ab52-e6da891cbdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:20.205596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1ac94-7ad2-4e6f-ab52-e6da891cbdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:20.205865 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1ac94-7ad2-4e6f-ab52-e6da891cbdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:20.206133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1ac94-7ad2-4e6f-ab52-e6da891cbdd2 None admin] PATH_INFO: `/v3/groups/4ae01027723a43729f77746b6e25a2aa` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:20.207317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1ac94-7ad2-4e6f-ab52-e6da891cbdd2 None admin] RBAC: Authorizing `identity:get_group(group_id=4ae01027723a43729f77746b6e25a2aa)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:20.208777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1ac94-7ad2-4e6f-ab52-e6da891cbdd2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:20.210441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 233/452] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:20 2022] GET /identity/v3/groups/4ae01027723a43729f77746b6e25a2aa => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:20.219072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1ac94-7ad2-4e6f-ab52-e6da891cbdd2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:20.264366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3b66-8741-4f24-aebc-881005332cf0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:20.309465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:20.316252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb756f-6a49-466f-a140-b9f6c55bec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:20.317121 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb756f-6a49-466f-a140-b9f6c55bec5b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:20.317438 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb756f-6a49-466f-a140-b9f6c55bec5b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:20.317716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb756f-6a49-466f-a140-b9f6c55bec5b None admin] PATH_INFO: `/v3/groups/998d809837864c208becc5d92a608db5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:20.318981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb756f-6a49-466f-a140-b9f6c55bec5b None admin] RBAC: Authorizing `identity:get_group(group_id=998d809837864c208becc5d92a608db5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:20.320455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb756f-6a49-466f-a140-b9f6c55bec5b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:20.320694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:20.322227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 220/453] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 17 14:59:20 2022] GET /identity/v3/groups/998d809837864c208becc5d92a608db5 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:20.331336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb756f-6a49-466f-a140-b9f6c55bec5b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:20.341498 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1ac94-7ad2-4e6f-ab52-e6da891cbdd2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:20.379994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e970-2aff-47c7-8a5d-3b95dd7aa131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:20.380657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e970-2aff-47c7-8a5d-3b95dd7aa131 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:20.380935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e970-2aff-47c7-8a5d-3b95dd7aa131 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:20.381230 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e970-2aff-47c7-8a5d-3b95dd7aa131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:20.382128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e970-2aff-47c7-8a5d-3b95dd7aa131 None admin] RBAC: Adding query filter params (group.id=4ae01027723a43729f77746b6e25a2aa, role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=2862ed4e06e54fce9d45a21ed40f7a44) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:20.382443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e970-2aff-47c7-8a5d-3b95dd7aa131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:20.383882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e970-2aff-47c7-8a5d-3b95dd7aa131 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:20.390622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 234/454] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 17 14:59:20 2022] GET /identity/v3/role_assignments?group.id=4ae01027723a43729f77746b6e25a2aa&scope.project.id=2862ed4e06e54fce9d45a21ed40f7a44&role.id=8a6fe5045159487aa0119348cfe94387 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:20.475541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb756f-6a49-466f-a140-b9f6c55bec5b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:20.515820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d70e66-1417-4f54-bcf4-ef14c5b39f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:20.516397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d70e66-1417-4f54-bcf4-ef14c5b39f10 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:20.516675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d70e66-1417-4f54-bcf4-ef14c5b39f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:20.516946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d70e66-1417-4f54-bcf4-ef14c5b39f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:20.517811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d70e66-1417-4f54-bcf4-ef14c5b39f10 None admin] RBAC: Adding query filter params (group.id=998d809837864c208becc5d92a608db5, role.id=f36f89c30b0a4c38900202ea156ed20e, scope.project.id=346276b0f40e4a0c84018861d282281c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:20.518120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d70e66-1417-4f54-bcf4-ef14c5b39f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:20.519624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d70e66-1417-4f54-bcf4-ef14c5b39f10 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:20.526819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 221/455] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 17 14:59:20 2022] GET /identity/v3/role_assignments?group.id=998d809837864c208becc5d92a608db5&scope.project.id=346276b0f40e4a0c84018861d282281c&role.id=f36f89c30b0a4c38900202ea156ed20e => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:23.427009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fe77e-bdcc-418e-94f0-bd9d80116306 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:23.427592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fe77e-bdcc-418e-94f0-bd9d80116306 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:23.427592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fe77e-bdcc-418e-94f0-bd9d80116306 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:23.429240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 235/456] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:23.434805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f4e4-66b1-40bd-b852-080b5a70928c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:23.435296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f4e4-66b1-40bd-b852-080b5a70928c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:23.435657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f4e4-66b1-40bd-b852-080b5a70928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:23.463565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6fc0f4e4-66b1-40bd-b852-080b5a70928c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:23.464810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6fc0f4e4-66b1-40bd-b852-080b5a70928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:23.572059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:23.586083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 222/457] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:23.648090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fe77e-bdcc-418e-94f0-bd9d80116306 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:23.766988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37634a76-db83-4dbf-9d3c-e695a0fcf183 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:23.767336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37634a76-db83-4dbf-9d3c-e695a0fcf183 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:23.767543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37634a76-db83-4dbf-9d3c-e695a0fcf183 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:23.769105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 223/458] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:59:23.776645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed723b3-5ade-4373-90c5-9ad0deabc328 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:23.776944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed723b3-5ade-4373-90c5-9ad0deabc328 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:23.777296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed723b3-5ade-4373-90c5-9ad0deabc328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:23.810676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bed723b3-5ade-4373-90c5-9ad0deabc328 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:23.812038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bed723b3-5ade-4373-90c5-9ad0deabc328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:23.829846 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fe77e-bdcc-418e-94f0-bd9d80116306 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:23.890068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d60c4-4b23-4ccb-ab02-0cc84998a125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:23.890882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d60c4-4b23-4ccb-ab02-0cc84998a125 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:23.891162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d60c4-4b23-4ccb-ab02-0cc84998a125 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:23.891438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d60c4-4b23-4ccb-ab02-0cc84998a125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:23.904556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d60c4-4b23-4ccb-ab02-0cc84998a125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:23.907183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d60c4-4b23-4ccb-ab02-0cc84998a125 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:23.915475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c52d60c4-4b23-4ccb-ab02-0cc84998a125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:23.931135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:23.932116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:23.933070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:23.933070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:23.933070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:23.933070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:23.933070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 236/459] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:23.934107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ab47-f376-4ca8-bc1f-797a952f2241 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:23.934577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ab47-f376-4ca8-bc1f-797a952f2241 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:23.934985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ab47-f376-4ca8-bc1f-797a952f2241 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:23.936418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 237/460] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:23.937250 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 224/461] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:23.941716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ab47-f376-4ca8-bc1f-797a952f2241 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:23.942654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b442d6d-4c0a-44d2-adcb-125b34bc69e6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:23.943195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b442d6d-4c0a-44d2-adcb-125b34bc69e6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:23.943674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b442d6d-4c0a-44d2-adcb-125b34bc69e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:23.961465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6b442d6d-4c0a-44d2-adcb-125b34bc69e6 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:23.963114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6b442d6d-4c0a-44d2-adcb-125b34bc69e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:24.046018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 225/462] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:24.054246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b442d6d-4c0a-44d2-adcb-125b34bc69e6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:24.091667 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ab47-f376-4ca8-bc1f-797a952f2241 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:24.134294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a9b27-ff47-47e4-b60f-73b50912962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:24.135798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a9b27-ff47-47e4-b60f-73b50912962b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:24.136268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a9b27-ff47-47e4-b60f-73b50912962b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:24.136699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a9b27-ff47-47e4-b60f-73b50912962b None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:24.137618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a9b27-ff47-47e4-b60f-73b50912962b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:24.138072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a9b27-ff47-47e4-b60f-73b50912962b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:24.139693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a9b27-ff47-47e4-b60f-73b50912962b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:24.150282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:24.167302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 238/463] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:24.169074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a9b27-ff47-47e4-b60f-73b50912962b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:24.216351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b442d6d-4c0a-44d2-adcb-125b34bc69e6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:24.253796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:24.273318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db5c30-67c9-4cd3-83e2-0d036d8bf9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:24.275134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db5c30-67c9-4cd3-83e2-0d036d8bf9de None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:24.275818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db5c30-67c9-4cd3-83e2-0d036d8bf9de None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:24.276361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db5c30-67c9-4cd3-83e2-0d036d8bf9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:24.293102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db5c30-67c9-4cd3-83e2-0d036d8bf9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:24.296245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db5c30-67c9-4cd3-83e2-0d036d8bf9de None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-49db5c30-67c9-4cd3-83e2-0d036d8bf9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:24.319384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:24.320297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:24.321162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:24.321162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:24.321162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:24.321162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:24.321862 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a9b27-ff47-47e4-b60f-73b50912962b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:24.329156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 226/464] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:24.330524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db5c30-67c9-4cd3-83e2-0d036d8bf9de None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:24.362934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f8e7f-ed4b-4aac-8b0f-da355ba00efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:24.363730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f8e7f-ed4b-4aac-8b0f-da355ba00efc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:24.364008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f8e7f-ed4b-4aac-8b0f-da355ba00efc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:24.364278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f8e7f-ed4b-4aac-8b0f-da355ba00efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:24.377319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f8e7f-ed4b-4aac-8b0f-da355ba00efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:24.378791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f8e7f-ed4b-4aac-8b0f-da355ba00efc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7f8f8e7f-ed4b-4aac-8b0f-da355ba00efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:24.397973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:24.398991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:24.400128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:24.400128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:24.400128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:24.400128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:24.400128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 239/465] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:24.405514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f8e7f-ed4b-4aac-8b0f-da355ba00efc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:24.462639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db5c30-67c9-4cd3-83e2-0d036d8bf9de None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:24.476445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:24.519062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a744d0-6b35-45ba-9cbb-5aa41ed03871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:24.520003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a744d0-6b35-45ba-9cbb-5aa41ed03871 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:24.520273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a744d0-6b35-45ba-9cbb-5aa41ed03871 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:24.520588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a744d0-6b35-45ba-9cbb-5aa41ed03871 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:24.521773 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a744d0-6b35-45ba-9cbb-5aa41ed03871 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:24.524137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a744d0-6b35-45ba-9cbb-5aa41ed03871 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:24.533302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f8e7f-ed4b-4aac-8b0f-da355ba00efc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:24.551158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:24.554457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 227/466] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:59:24 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:59:24.556041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd121ba-4d10-46db-9a05-a573e16a6ca5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:24.556379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd121ba-4d10-46db-9a05-a573e16a6ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:24.556665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd121ba-4d10-46db-9a05-a573e16a6ca5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:24.558752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 228/467] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:24.564691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd121ba-4d10-46db-9a05-a573e16a6ca5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:24.606367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b4d95-9208-406b-8f62-b4410a7a25e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:24.608187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4d95-9208-406b-8f62-b4410a7a25e2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:24.608692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4d95-9208-406b-8f62-b4410a7a25e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:24.609442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4d95-9208-406b-8f62-b4410a7a25e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:24.610441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4d95-9208-406b-8f62-b4410a7a25e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:24.610931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4d95-9208-406b-8f62-b4410a7a25e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:24.612521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4d95-9208-406b-8f62-b4410a7a25e2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:24.631481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 240/468] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:24.633709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be7b4b-764b-4ae3-b7fb-d0668c228c37 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:24.634209 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be7b4b-764b-4ae3-b7fb-d0668c228c37 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:24.634659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be7b4b-764b-4ae3-b7fb-d0668c228c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:24.665824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e2be7b4b-764b-4ae3-b7fb-d0668c228c37 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:24.668130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e2be7b4b-764b-4ae3-b7fb-d0668c228c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:24.712880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd121ba-4d10-46db-9a05-a573e16a6ca5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:24.766894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 241/469] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:24.767610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be7b4b-764b-4ae3-b7fb-d0668c228c37 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:24.769993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78c262-e0aa-4744-8d63-3dd54ea6ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:24.770685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78c262-e0aa-4744-8d63-3dd54ea6ad46 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:24.770968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78c262-e0aa-4744-8d63-3dd54ea6ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:24.771243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78c262-e0aa-4744-8d63-3dd54ea6ad46 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:24.772789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78c262-e0aa-4744-8d63-3dd54ea6ad46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:24.772789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78c262-e0aa-4744-8d63-3dd54ea6ad46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:24.773707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78c262-e0aa-4744-8d63-3dd54ea6ad46 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:24.801617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 229/470] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:24.802454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78c262-e0aa-4744-8d63-3dd54ea6ad46 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:24.833507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:24.899875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be7b4b-764b-4ae3-b7fb-d0668c228c37 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:24.902777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:24.935357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78c262-e0aa-4744-8d63-3dd54ea6ad46 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:24.947450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e358-7459-49d6-8ad6-8796b887483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:24.948998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e358-7459-49d6-8ad6-8796b887483d None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:24.949466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e358-7459-49d6-8ad6-8796b887483d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:24.949889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e358-7459-49d6-8ad6-8796b887483d None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:24.951429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e358-7459-49d6-8ad6-8796b887483d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:24.953425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e358-7459-49d6-8ad6-8796b887483d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:24.978027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cd78c-021a-41ba-814f-bca297e4c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:24.985419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 242/471] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:59:24 2022] POST /identity/v3/users => generated 246 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:59:24.985650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cd78c-021a-41ba-814f-bca297e4c453 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:24.985650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cd78c-021a-41ba-814f-bca297e4c453 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:24.985836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e358-7459-49d6-8ad6-8796b887483d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:24.985903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cd78c-021a-41ba-814f-bca297e4c453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:24.999830 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cd78c-021a-41ba-814f-bca297e4c453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:25.001423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cd78c-021a-41ba-814f-bca297e4c453 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c05cd78c-021a-41ba-814f-bca297e4c453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:25.021954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:25.022878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:25.023703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:25.023703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:25.023703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:25.023703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:25.023703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 230/472] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:25.024609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b44c-4437-440a-9283-b307e3e12d4d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:25.024959 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b44c-4437-440a-9283-b307e3e12d4d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:25.029234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b44c-4437-440a-9283-b307e3e12d4d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:25.029234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 231/473] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:25.029234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b44c-4437-440a-9283-b307e3e12d4d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:25.119151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e358-7459-49d6-8ad6-8796b887483d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:25.135387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:25.159639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feea2d-ab2b-4dce-acaf-7d0841aad28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:25.160316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feea2d-ab2b-4dce-acaf-7d0841aad28e None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:25.160596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feea2d-ab2b-4dce-acaf-7d0841aad28e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:25.160870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feea2d-ab2b-4dce-acaf-7d0841aad28e None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:25.161641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99feea2d-ab2b-4dce-acaf-7d0841aad28e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:25.163146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99feea2d-ab2b-4dce-acaf-7d0841aad28e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:25.170785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b44c-4437-440a-9283-b307e3e12d4d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:25.193288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 243/474] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:59:24 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:59:25.194875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876c0b1-0186-465f-aa39-7ea2e2ba40eb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:25.195160 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876c0b1-0186-465f-aa39-7ea2e2ba40eb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:25.195484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876c0b1-0186-465f-aa39-7ea2e2ba40eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:25.218406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0876c0b1-0186-465f-aa39-7ea2e2ba40eb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:25.220034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0876c0b1-0186-465f-aa39-7ea2e2ba40eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:25.221079 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a05637-7baf-4900-bb22-9d9bb387e142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:25.222140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05637-7baf-4900-bb22-9d9bb387e142 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:25.222628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05637-7baf-4900-bb22-9d9bb387e142 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:25.223174 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05637-7baf-4900-bb22-9d9bb387e142 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:25.224175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a05637-7baf-4900-bb22-9d9bb387e142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:25.224695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a05637-7baf-4900-bb22-9d9bb387e142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:25.226424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a05637-7baf-4900-bb22-9d9bb387e142 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:25.229156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:25.240980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 232/475] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:25.247627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a05637-7baf-4900-bb22-9d9bb387e142 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:25.310985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 244/476] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:25.347630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876c0b1-0186-465f-aa39-7ea2e2ba40eb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:25.382852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a05637-7baf-4900-bb22-9d9bb387e142 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:25.421924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264646f-b635-4b52-92d3-b4c1e3ac5641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:25.423033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264646f-b635-4b52-92d3-b4c1e3ac5641 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:25.423539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264646f-b635-4b52-92d3-b4c1e3ac5641 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:25.424031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264646f-b635-4b52-92d3-b4c1e3ac5641 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:25.424934 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264646f-b635-4b52-92d3-b4c1e3ac5641 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:25.426602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264646f-b635-4b52-92d3-b4c1e3ac5641 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:25.434094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:25.454938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 233/477] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:59:25 2022] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:59:25.487534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876c0b1-0186-465f-aa39-7ea2e2ba40eb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:25.531368 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14986763-7d4b-4679-b479-2350b84febc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:25.532491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14986763-7d4b-4679-b479-2350b84febc5 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:25.532987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14986763-7d4b-4679-b479-2350b84febc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:25.533607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14986763-7d4b-4679-b479-2350b84febc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:25.535118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14986763-7d4b-4679-b479-2350b84febc5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:25.536766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14986763-7d4b-4679-b479-2350b84febc5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:25.545041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.sql.core [None req-14986763-7d4b-4679-b479-2350b84febc5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 14:59:25.545041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 14:59:25.545041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [parameters: {'id': '874dc71434f14eec96e02930fca495a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 14:59:25.545041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80333) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-14986763-7d4b-4679-b479-2350b84febc5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Jun 17 14:59:25.563305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return ref.to_dict() Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 14:59:25.564231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application yield resource Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise self.value Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application session.commit() Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 14:59:25.565134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.flush() Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application compat.raise_( Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 14:59:25.566046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 14:59:25.566921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 14:59:25.567728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [parameters: {'id': '874dc71434f14eec96e02930fca495a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:25.568506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 14:59:25.570877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:25.575114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 245/478] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Jun 17 14:59:25 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:25.581720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264646f-b635-4b52-92d3-b4c1e3ac5641 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:25.696525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264646f-b635-4b52-92d3-b4c1e3ac5641 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:25.731710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31767b-b4bd-4efe-8941-8bc6da169157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:25.732530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31767b-b4bd-4efe-8941-8bc6da169157 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:25.732814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31767b-b4bd-4efe-8941-8bc6da169157 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:25.733093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31767b-b4bd-4efe-8941-8bc6da169157 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:25.743818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31767b-b4bd-4efe-8941-8bc6da169157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cd31767b-b4bd-4efe-8941-8bc6da169157 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:25.752237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:25.753122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:25.753942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 234/479] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 14:59:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:25.760462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14986763-7d4b-4679-b479-2350b84febc5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:25.771316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:25.877713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14986763-7d4b-4679-b479-2350b84febc5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:25.915510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5995b35-0ccc-44a3-a47a-230faafbb45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:25.916231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5995b35-0ccc-44a3-a47a-230faafbb45e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:25.916513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5995b35-0ccc-44a3-a47a-230faafbb45e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:25.916791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5995b35-0ccc-44a3-a47a-230faafbb45e None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:25.917594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5995b35-0ccc-44a3-a47a-230faafbb45e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:25.917962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5995b35-0ccc-44a3-a47a-230faafbb45e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:25.919387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5995b35-0ccc-44a3-a47a-230faafbb45e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:25.929409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 246/480] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:27.338993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29bdc6-34b3-4bce-aea2-63478ba22786 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:27.339555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29bdc6-34b3-4bce-aea2-63478ba22786 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:27.339555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29bdc6-34b3-4bce-aea2-63478ba22786 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:27.341233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 235/481] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:27.349968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715f54-8c16-458a-8c80-4d8188518099 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:27.350484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715f54-8c16-458a-8c80-4d8188518099 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:27.350574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715f54-8c16-458a-8c80-4d8188518099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:27.368942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b1715f54-8c16-458a-8c80-4d8188518099 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:27.370426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b1715f54-8c16-458a-8c80-4d8188518099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:27.436753 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:27.442498 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 247/482] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:27.483238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29bdc6-34b3-4bce-aea2-63478ba22786 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:27.553565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:27.622378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29bdc6-34b3-4bce-aea2-63478ba22786 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:27.678239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e8888-206b-4b76-9cc8-f40e4755dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:27.679055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8888-206b-4b76-9cc8-f40e4755dc8e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:27.679348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8888-206b-4b76-9cc8-f40e4755dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:27.679628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8888-206b-4b76-9cc8-f40e4755dc8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:27.698320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e8888-206b-4b76-9cc8-f40e4755dc8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d37e8888-206b-4b76-9cc8-f40e4755dc8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:27.707100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:27.708011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:27.708804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 236/483] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:27.718478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1715f54-8c16-458a-8c80-4d8188518099 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:27.876656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa972b-edaa-484b-b73f-ca296b6bb1b5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:27.876839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa972b-edaa-484b-b73f-ca296b6bb1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:27.877288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa972b-edaa-484b-b73f-ca296b6bb1b5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:27.881438 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 237/484] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:59:27.890215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9db97-5036-46d6-a14b-89cfc4ad009c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:27.891029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9db97-5036-46d6-a14b-89cfc4ad009c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:27.892809 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9db97-5036-46d6-a14b-89cfc4ad009c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:27.905372 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1715f54-8c16-458a-8c80-4d8188518099 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:27.927153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c8d9db97-5036-46d6-a14b-89cfc4ad009c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:27.930007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c8d9db97-5036-46d6-a14b-89cfc4ad009c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:27.967707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c785f1-9376-44e4-92fc-b86c5c392544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:27.969193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c785f1-9376-44e4-92fc-b86c5c392544 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:27.970370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c785f1-9376-44e4-92fc-b86c5c392544 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:27.971020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c785f1-9376-44e4-92fc-b86c5c392544 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:27.972165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c785f1-9376-44e4-92fc-b86c5c392544 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:27.972972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c785f1-9376-44e4-92fc-b86c5c392544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:27.975629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c785f1-9376-44e4-92fc-b86c5c392544 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:27.988906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 248/485] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:27.990678 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a448d-0683-4f4f-a4ed-d958b8000a6f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:27.991156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a448d-0683-4f4f-a4ed-d958b8000a6f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:27.991618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a448d-0683-4f4f-a4ed-d958b8000a6f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:27.993115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 249/486] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:28.002272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a448d-0683-4f4f-a4ed-d958b8000a6f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:28.037753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 238/487] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:28.039741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27527ab5-3fad-48c7-a1bb-b34672ddc444 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.040170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27527ab5-3fad-48c7-a1bb-b34672ddc444 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.040651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27527ab5-3fad-48c7-a1bb-b34672ddc444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.062652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-27527ab5-3fad-48c7-a1bb-b34672ddc444 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:28.064350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-27527ab5-3fad-48c7-a1bb-b34672ddc444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:28.084941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:28.113025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:28.149119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a448d-0683-4f4f-a4ed-d958b8000a6f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:28.170743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 239/488] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:28.172031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27527ab5-3fad-48c7-a1bb-b34672ddc444 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:28.189706 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956abf4-e3a2-460d-9289-856df2ba47fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:28.190567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956abf4-e3a2-460d-9289-856df2ba47fd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.190845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956abf4-e3a2-460d-9289-856df2ba47fd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.191116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956abf4-e3a2-460d-9289-856df2ba47fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.208224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956abf4-e3a2-460d-9289-856df2ba47fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:28.211081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956abf4-e3a2-460d-9289-856df2ba47fd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8956abf4-e3a2-460d-9289-856df2ba47fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:28.244126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:28.245025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:28.245922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:28.245922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:28.245922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:28.245922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:28.246913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 250/489] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:28.248348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956abf4-e3a2-460d-9289-856df2ba47fd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:28.306233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27527ab5-3fad-48c7-a1bb-b34672ddc444 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:28.349026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529cd97-0731-40f5-9aed-f51c30ff04e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:28.349893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529cd97-0731-40f5-9aed-f51c30ff04e3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.350158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529cd97-0731-40f5-9aed-f51c30ff04e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.350424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529cd97-0731-40f5-9aed-f51c30ff04e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.362129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529cd97-0731-40f5-9aed-f51c30ff04e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0529cd97-0731-40f5-9aed-f51c30ff04e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:28.374856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:28.375828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:28.376613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 240/490] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:28.378031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529cd97-0731-40f5-9aed-f51c30ff04e3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:28.411457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956abf4-e3a2-460d-9289-856df2ba47fd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:28.413381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:28.428047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:28.454972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea9ce7-d82f-428d-ac47-e50af6d3fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:28.456081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea9ce7-d82f-428d-ac47-e50af6d3fa9e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.456397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea9ce7-d82f-428d-ac47-e50af6d3fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.456645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea9ce7-d82f-428d-ac47-e50af6d3fa9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.470774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea9ce7-d82f-428d-ac47-e50af6d3fa9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-feea9ce7-d82f-428d-ac47-e50af6d3fa9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:28.478968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:28.479860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:28.480647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:28.481323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 251/491] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:28.482988 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955966-76f4-4962-bc44-7d1d5b229943 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.483444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955966-76f4-4962-bc44-7d1d5b229943 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.483888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955966-76f4-4962-bc44-7d1d5b229943 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.490684 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 252/492] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:28.491456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955966-76f4-4962-bc44-7d1d5b229943 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:28.514390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529cd97-0731-40f5-9aed-f51c30ff04e3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:28.553186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7a5e2-39b5-4626-a5b4-52ac69516154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:28.554051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7a5e2-39b5-4626-a5b4-52ac69516154 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.554332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7a5e2-39b5-4626-a5b4-52ac69516154 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.554668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7a5e2-39b5-4626-a5b4-52ac69516154 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.555333 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7a5e2-39b5-4626-a5b4-52ac69516154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:28.555642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7a5e2-39b5-4626-a5b4-52ac69516154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:28.557130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7a5e2-39b5-4626-a5b4-52ac69516154 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:28.571125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 241/493] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:28.572571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7a5e2-39b5-4626-a5b4-52ac69516154 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:28.606315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955966-76f4-4962-bc44-7d1d5b229943 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:28.652124 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d856b70-0a2a-4dc8-b262-270593469f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:28.652816 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d856b70-0a2a-4dc8-b262-270593469f03 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.653094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d856b70-0a2a-4dc8-b262-270593469f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.653390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d856b70-0a2a-4dc8-b262-270593469f03 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.654143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d856b70-0a2a-4dc8-b262-270593469f03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:28.654450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d856b70-0a2a-4dc8-b262-270593469f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:28.655841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d856b70-0a2a-4dc8-b262-270593469f03 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:28.664725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 253/494] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:28.665963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600577-8f51-4aed-83f0-b732463049c8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.666377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600577-8f51-4aed-83f0-b732463049c8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.666946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600577-8f51-4aed-83f0-b732463049c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.683238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:28.686900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-75600577-8f51-4aed-83f0-b732463049c8 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:28.688104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-75600577-8f51-4aed-83f0-b732463049c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:28.694913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7a5e2-39b5-4626-a5b4-52ac69516154 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:28.717607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:28.732691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47c59b-1d2e-421a-bdfb-72419fd2306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:28.733426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47c59b-1d2e-421a-bdfb-72419fd2306c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.733704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47c59b-1d2e-421a-bdfb-72419fd2306c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.733976 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47c59b-1d2e-421a-bdfb-72419fd2306c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.734720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47c59b-1d2e-421a-bdfb-72419fd2306c None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:28.735028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47c59b-1d2e-421a-bdfb-72419fd2306c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:28.736447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47c59b-1d2e-421a-bdfb-72419fd2306c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:28.745709 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 242/495] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:28.746762 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47c59b-1d2e-421a-bdfb-72419fd2306c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:28.767276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 254/496] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:28.768304 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75600577-8f51-4aed-83f0-b732463049c8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:28.867675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47c59b-1d2e-421a-bdfb-72419fd2306c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:28.884425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75600577-8f51-4aed-83f0-b732463049c8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:28.904425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01ed6a-7fe8-4e90-8097-358c77cd506c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:28.905630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ed6a-7fe8-4e90-8097-358c77cd506c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.906117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ed6a-7fe8-4e90-8097-358c77cd506c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.906572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ed6a-7fe8-4e90-8097-358c77cd506c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.915390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ed6a-7fe8-4e90-8097-358c77cd506c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:28.917523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ed6a-7fe8-4e90-8097-358c77cd506c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:28.918668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea48b09-af87-444a-97f6-905958b45055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:28.919473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea48b09-af87-444a-97f6-905958b45055 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:28.919749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea48b09-af87-444a-97f6-905958b45055 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:28.920012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea48b09-af87-444a-97f6-905958b45055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:28.930234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea48b09-af87-444a-97f6-905958b45055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:28.931783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea48b09-af87-444a-97f6-905958b45055 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-eb01ed6a-7fe8-4e90-8097-358c77cd506c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:28.935403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:28.936268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:28.937188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:28.937188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:28.937188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:28.937188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:28.937188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:28.937188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:28.937188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:28.937188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:28.937188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 14:59:28.937188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:28.943156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 243/497] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:28.943156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01ed6a-7fe8-4e90-8097-358c77cd506c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8ea48b09-af87-444a-97f6-905958b45055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:28.953752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:28.954593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:28.955470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:28.955470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:28.955470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:28.955470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:28.955470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 255/498] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:28.956284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea48b09-af87-444a-97f6-905958b45055 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:28.963976 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:28.982060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:29.056863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01ed6a-7fe8-4e90-8097-358c77cd506c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:29.075182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea48b09-af87-444a-97f6-905958b45055 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:29.094319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742e827-e033-458b-a9ba-7fc4fe0f07c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:29.095130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e827-e033-458b-a9ba-7fc4fe0f07c0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.095402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e827-e033-458b-a9ba-7fc4fe0f07c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.095670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e827-e033-458b-a9ba-7fc4fe0f07c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.106617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742e827-e033-458b-a9ba-7fc4fe0f07c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:29.108109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742e827-e033-458b-a9ba-7fc4fe0f07c0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:29.112820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007ccb-d811-4967-bb08-1f785a43026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:29.113662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007ccb-d811-4967-bb08-1f785a43026a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.113940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007ccb-d811-4967-bb08-1f785a43026a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.114210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007ccb-d811-4967-bb08-1f785a43026a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.124535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea007ccb-d811-4967-bb08-1f785a43026a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c742e827-e033-458b-a9ba-7fc4fe0f07c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:29.125668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:29.126542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:29.127371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:29.127371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:29.127371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:29.127371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:29.127371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 244/499] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:29.127642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742e827-e033-458b-a9ba-7fc4fe0f07c0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ea007ccb-d811-4967-bb08-1f785a43026a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:29.132180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:29.133241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:29.134058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 256/500] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:29.137582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007ccb-d811-4967-bb08-1f785a43026a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:29.198770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:29.214926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:29.239119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007ccb-d811-4967-bb08-1f785a43026a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:29.239334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742e827-e033-458b-a9ba-7fc4fe0f07c0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:29.272623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f65f5-bb58-4a8b-b4d8-18febd07de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:29.273311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f65f5-bb58-4a8b-b4d8-18febd07de60 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.273538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c5aef-3175-4af7-87a6-64bf71886e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:29.273645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f65f5-bb58-4a8b-b4d8-18febd07de60 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.273858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f65f5-bb58-4a8b-b4d8-18febd07de60 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.274232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c5aef-3175-4af7-87a6-64bf71886e01 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.274446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c5aef-3175-4af7-87a6-64bf71886e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.274726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f65f5-bb58-4a8b-b4d8-18febd07de60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:29.274823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c5aef-3175-4af7-87a6-64bf71886e01 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.275035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f65f5-bb58-4a8b-b4d8-18febd07de60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:29.275553 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c5aef-3175-4af7-87a6-64bf71886e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:29.275870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c5aef-3175-4af7-87a6-64bf71886e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:29.276907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f65f5-bb58-4a8b-b4d8-18febd07de60 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:29.277228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c5aef-3175-4af7-87a6-64bf71886e01 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:29.289436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 257/501] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:29.290742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb90fc2-f93c-4608-9522-8afa5577bfda None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.291166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb90fc2-f93c-4608-9522-8afa5577bfda None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.291539 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb90fc2-f93c-4608-9522-8afa5577bfda None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.292782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 258/502] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:29.293510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb90fc2-f93c-4608-9522-8afa5577bfda None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:29.314581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 245/503] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 17 14:59:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:29.315423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f65f5-bb58-4a8b-b4d8-18febd07de60 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:29.402547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb90fc2-f93c-4608-9522-8afa5577bfda None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:29.414953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f65f5-bb58-4a8b-b4d8-18febd07de60 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:29.437410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:29.439551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa329ba-699a-4556-93c8-886f7902925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:29.440226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa329ba-699a-4556-93c8-886f7902925a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.440499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa329ba-699a-4556-93c8-886f7902925a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.440780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa329ba-699a-4556-93c8-886f7902925a None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.441531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa329ba-699a-4556-93c8-886f7902925a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:29.441832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa329ba-699a-4556-93c8-886f7902925a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:29.443212 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa329ba-699a-4556-93c8-886f7902925a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:29.445978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:29.449671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc62132-13ab-4456-bc1b-2a66167db7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:29.450276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc62132-13ab-4456-bc1b-2a66167db7ff None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.450557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc62132-13ab-4456-bc1b-2a66167db7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.450831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc62132-13ab-4456-bc1b-2a66167db7ff None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.451901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc62132-13ab-4456-bc1b-2a66167db7ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:29.452205 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc62132-13ab-4456-bc1b-2a66167db7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:29.453612 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc62132-13ab-4456-bc1b-2a66167db7ff None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:29.456614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 259/504] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:29.458051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa329ba-699a-4556-93c8-886f7902925a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:29.462055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 246/505] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:29.463729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d231-19d2-4b94-a928-5dd1f8ffc9c0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.464034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d231-19d2-4b94-a928-5dd1f8ffc9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.464327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d231-19d2-4b94-a928-5dd1f8ffc9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.481318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2b06d231-19d2-4b94-a928-5dd1f8ffc9c0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:29.482545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2b06d231-19d2-4b94-a928-5dd1f8ffc9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:29.548483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 247/506] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:29.549369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d231-19d2-4b94-a928-5dd1f8ffc9c0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:29.559401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa329ba-699a-4556-93c8-886f7902925a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:29.594667 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd5886-8fe4-4472-9a62-deff9c20d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:29.595477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd5886-8fe4-4472-9a62-deff9c20d2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.595755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd5886-8fe4-4472-9a62-deff9c20d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.596072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd5886-8fe4-4472-9a62-deff9c20d2f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.604850 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd5886-8fe4-4472-9a62-deff9c20d2f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:29.606348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd5886-8fe4-4472-9a62-deff9c20d2f9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4efd5886-8fe4-4472-9a62-deff9c20d2f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:29.622522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:29.623449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 260/507] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 17 14:59:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:29.629137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd5886-8fe4-4472-9a62-deff9c20d2f9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:29.666013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d231-19d2-4b94-a928-5dd1f8ffc9c0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:29.688023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:29.690833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:29.714025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fde5e1-6123-4b80-b3cd-fbd29fc28223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:29.714710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde5e1-6123-4b80-b3cd-fbd29fc28223 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.714995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde5e1-6123-4b80-b3cd-fbd29fc28223 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.715268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde5e1-6123-4b80-b3cd-fbd29fc28223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.753503 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd5886-8fe4-4472-9a62-deff9c20d2f9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:29.799614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fde5e1-6123-4b80-b3cd-fbd29fc28223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:29.801140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fde5e1-6123-4b80-b3cd-fbd29fc28223 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:29.802631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c541028-06f3-423e-b6c7-3b66b80d77c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:29.803498 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c541028-06f3-423e-b6c7-3b66b80d77c5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.803781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c541028-06f3-423e-b6c7-3b66b80d77c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.804067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c541028-06f3-423e-b6c7-3b66b80d77c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:29.814670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c541028-06f3-423e-b6c7-3b66b80d77c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:29.816221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c541028-06f3-423e-b6c7-3b66b80d77c5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8c541028-06f3-423e-b6c7-3b66b80d77c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:29.832430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:29.834351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 261/508] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:29.836131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c541028-06f3-423e-b6c7-3b66b80d77c5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:29.928574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 248/509] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:29.929760 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fde5e1-6123-4b80-b3cd-fbd29fc28223 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:29.946478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c541028-06f3-423e-b6c7-3b66b80d77c5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:29.946685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:29.966606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:29.987782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036ea70-3371-450c-826a-6b8cc2c0f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:29.988574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036ea70-3371-450c-826a-6b8cc2c0f9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:29.988873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036ea70-3371-450c-826a-6b8cc2c0f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:29.989132 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036ea70-3371-450c-826a-6b8cc2c0f9b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:30.000310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036ea70-3371-450c-826a-6b8cc2c0f9b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:30.002072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036ea70-3371-450c-826a-6b8cc2c0f9b1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5036ea70-3371-450c-826a-6b8cc2c0f9b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:30.019520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:30.020411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:30.021258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:30.021258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:30.021258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:30.021258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:30.021258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 262/510] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:30.021532 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036ea70-3371-450c-826a-6b8cc2c0f9b1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:30.038545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fde5e1-6123-4b80-b3cd-fbd29fc28223 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:30.074314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5207b4-7915-4064-a4a1-2492cf42140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:30.075130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5207b4-7915-4064-a4a1-2492cf42140a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:30.075409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5207b4-7915-4064-a4a1-2492cf42140a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:30.075682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5207b4-7915-4064-a4a1-2492cf42140a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:30.086902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5207b4-7915-4064-a4a1-2492cf42140a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:30.088609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5207b4-7915-4064-a4a1-2492cf42140a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7b5207b4-7915-4064-a4a1-2492cf42140a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:30.107392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:30.108346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:30.109179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:30.109179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:30.109179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:30.109179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:30.109179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 249/511] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:30.109479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5207b4-7915-4064-a4a1-2492cf42140a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:30.129714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036ea70-3371-450c-826a-6b8cc2c0f9b1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:30.163454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bcfa9-03dc-4fe3-8924-5f07d259001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:30.164156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bcfa9-03dc-4fe3-8924-5f07d259001c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:30.164429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bcfa9-03dc-4fe3-8924-5f07d259001c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:30.164695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bcfa9-03dc-4fe3-8924-5f07d259001c None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:30.165646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bcfa9-03dc-4fe3-8924-5f07d259001c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:30.166007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bcfa9-03dc-4fe3-8924-5f07d259001c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:30.167485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bcfa9-03dc-4fe3-8924-5f07d259001c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:30.176475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:30.206860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 263/512] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 17 14:59:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:30.207937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bcfa9-03dc-4fe3-8924-5f07d259001c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:30.214539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5207b4-7915-4064-a4a1-2492cf42140a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:30.236107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:30.251041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3c9a-0b2a-457b-9362-af61ba9c125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:30.251714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3c9a-0b2a-457b-9362-af61ba9c125f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:30.251995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3c9a-0b2a-457b-9362-af61ba9c125f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:30.252287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3c9a-0b2a-457b-9362-af61ba9c125f None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:30.253099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3c9a-0b2a-457b-9362-af61ba9c125f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:30.253441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3c9a-0b2a-457b-9362-af61ba9c125f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:30.254884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3c9a-0b2a-457b-9362-af61ba9c125f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:30.272202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 250/513] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 17 14:59:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:30.272930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3c9a-0b2a-457b-9362-af61ba9c125f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:30.315246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bcfa9-03dc-4fe3-8924-5f07d259001c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:30.352148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232ee14-2d14-40dd-8efd-a932a2dde61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:30.352982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232ee14-2d14-40dd-8efd-a932a2dde61d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:30.353240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232ee14-2d14-40dd-8efd-a932a2dde61d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:30.353637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232ee14-2d14-40dd-8efd-a932a2dde61d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:30.364497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232ee14-2d14-40dd-8efd-a932a2dde61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:30.365996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232ee14-2d14-40dd-8efd-a932a2dde61d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:30.373890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3c9a-0b2a-457b-9362-af61ba9c125f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e232ee14-2d14-40dd-8efd-a932a2dde61d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:30.384289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:30.385611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:30.386495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:30.386495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:30.386495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:30.386495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:30.386495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 264/514] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:30.386761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232ee14-2d14-40dd-8efd-a932a2dde61d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:30.402299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:30.417625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdc867-dd1e-445b-baff-4c924c07239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:30.418304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc867-dd1e-445b-baff-4c924c07239d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:30.418561 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc867-dd1e-445b-baff-4c924c07239d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:30.418830 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc867-dd1e-445b-baff-4c924c07239d None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:30.419552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdc867-dd1e-445b-baff-4c924c07239d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:30.419852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdc867-dd1e-445b-baff-4c924c07239d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:30.421235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdc867-dd1e-445b-baff-4c924c07239d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:30.432832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 251/515] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:30.433723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdc867-dd1e-445b-baff-4c924c07239d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:30.474191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:30.500255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232ee14-2d14-40dd-8efd-a932a2dde61d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:30.535657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ca467-3747-486b-a0e2-8ad69509871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:30.536317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ca467-3747-486b-a0e2-8ad69509871e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:30.536588 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ca467-3747-486b-a0e2-8ad69509871e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:30.536855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ca467-3747-486b-a0e2-8ad69509871e None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:30.537602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ca467-3747-486b-a0e2-8ad69509871e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:30.537902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ca467-3747-486b-a0e2-8ad69509871e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:30.538917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdc867-dd1e-445b-baff-4c924c07239d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:30.539267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ca467-3747-486b-a0e2-8ad69509871e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:30.550823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 265/516] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:30.551645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ca467-3747-486b-a0e2-8ad69509871e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:30.573718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28310b4-2cce-46fe-a0ec-40e66b64987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:30.574365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28310b4-2cce-46fe-a0ec-40e66b64987c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:30.574643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28310b4-2cce-46fe-a0ec-40e66b64987c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:30.574914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28310b4-2cce-46fe-a0ec-40e66b64987c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:30.628363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:30.646219 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28310b4-2cce-46fe-a0ec-40e66b64987c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:30.647679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28310b4-2cce-46fe-a0ec-40e66b64987c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:30.659425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ca467-3747-486b-a0e2-8ad69509871e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:30.692951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead729-ea47-4ada-95e5-7e4d5732378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:30.693637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead729-ea47-4ada-95e5-7e4d5732378a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:30.693916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead729-ea47-4ada-95e5-7e4d5732378a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:30.694187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead729-ea47-4ada-95e5-7e4d5732378a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:30.704759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:30.754990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 252/517] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:30.755766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28310b4-2cce-46fe-a0ec-40e66b64987c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:30.766457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ead729-ea47-4ada-95e5-7e4d5732378a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:30.767925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ead729-ea47-4ada-95e5-7e4d5732378a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:30.854662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:30.872339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28310b4-2cce-46fe-a0ec-40e66b64987c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:30.880786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 266/518] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:30.881642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead729-ea47-4ada-95e5-7e4d5732378a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:30.910728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21ad0d-a0ba-46a0-9571-3f7328bb319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:30.911398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21ad0d-a0ba-46a0-9571-3f7328bb319a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:30.911671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21ad0d-a0ba-46a0-9571-3f7328bb319a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:30.911940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21ad0d-a0ba-46a0-9571-3f7328bb319a None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:30.912687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21ad0d-a0ba-46a0-9571-3f7328bb319a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:30.912978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21ad0d-a0ba-46a0-9571-3f7328bb319a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:30.914431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21ad0d-a0ba-46a0-9571-3f7328bb319a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:30.922919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:30.926490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 253/519] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:30.928295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21ad0d-a0ba-46a0-9571-3f7328bb319a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:30.987177 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead729-ea47-4ada-95e5-7e4d5732378a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:31.023950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e825931-f80e-43b9-bf29-d5a3cd115ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:31.024657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e825931-f80e-43b9-bf29-d5a3cd115ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:31.024925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e825931-f80e-43b9-bf29-d5a3cd115ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:31.025370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e825931-f80e-43b9-bf29-d5a3cd115ac4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:31.033176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e825931-f80e-43b9-bf29-d5a3cd115ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:31.034295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21ad0d-a0ba-46a0-9571-3f7328bb319a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:31.034679 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e825931-f80e-43b9-bf29-d5a3cd115ac4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9e825931-f80e-43b9-bf29-d5a3cd115ac4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:31.049867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:31.051657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 267/520] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:31.053421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e825931-f80e-43b9-bf29-d5a3cd115ac4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:31.087078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de4c8c-8423-4e1f-821e-2c89d74c068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:31.088202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de4c8c-8423-4e1f-821e-2c89d74c068b None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:31.088680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de4c8c-8423-4e1f-821e-2c89d74c068b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:31.089139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de4c8c-8423-4e1f-821e-2c89d74c068b None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:31.090524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de4c8c-8423-4e1f-821e-2c89d74c068b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:31.092783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de4c8c-8423-4e1f-821e-2c89d74c068b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:31.111366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:31.129239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 254/521] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:59:30 2022] POST /identity/v3/users => generated 247 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:59:31.129239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de4c8c-8423-4e1f-821e-2c89d74c068b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:31.171460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:31.176757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e825931-f80e-43b9-bf29-d5a3cd115ac4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:31.230622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b02dd-d5f6-4cea-933f-f0cf77474072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:31.231505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b02dd-d5f6-4cea-933f-f0cf77474072 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:31.231789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b02dd-d5f6-4cea-933f-f0cf77474072 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:31.232128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b02dd-d5f6-4cea-933f-f0cf77474072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:31.255802 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b02dd-d5f6-4cea-933f-f0cf77474072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:31.258091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b02dd-d5f6-4cea-933f-f0cf77474072 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:31.263902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de4c8c-8423-4e1f-821e-2c89d74c068b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e73b02dd-d5f6-4cea-933f-f0cf77474072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:31.287985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:31.289014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:31.289952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:31.289952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:31.289952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:31.289952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:31.292338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 268/522] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:31.293366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b02dd-d5f6-4cea-933f-f0cf77474072 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:31.310947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee0b02-4f9b-4094-9c76-d2b12a42d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:31.311755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee0b02-4f9b-4094-9c76-d2b12a42d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:31.312037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee0b02-4f9b-4094-9c76-d2b12a42d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:31.312341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee0b02-4f9b-4094-9c76-d2b12a42d7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:31.324923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee0b02-4f9b-4094-9c76-d2b12a42d7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:31.326775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee0b02-4f9b-4094-9c76-d2b12a42d7d9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-42ee0b02-4f9b-4094-9c76-d2b12a42d7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:31.348669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:31.350389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:31.351963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:31.351963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:31.351963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:31.351963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:31.351963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 255/523] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:31.351963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee0b02-4f9b-4094-9c76-d2b12a42d7d9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:31.413282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:31.431569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b02dd-d5f6-4cea-933f-f0cf77474072 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:31.467821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee0b02-4f9b-4094-9c76-d2b12a42d7d9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:31.472877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe358c-3f18-4464-b8b9-fcbaae656b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:31.473761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe358c-3f18-4464-b8b9-fcbaae656b42 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:31.474068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe358c-3f18-4464-b8b9-fcbaae656b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:31.474340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe358c-3f18-4464-b8b9-fcbaae656b42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:31.482251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe358c-3f18-4464-b8b9-fcbaae656b42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:31.483712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe358c-3f18-4464-b8b9-fcbaae656b42 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5efe358c-3f18-4464-b8b9-fcbaae656b42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:31.499335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:31.500333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:31.501183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:31.501183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:31.501183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:31.501183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:31.501183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:31.501183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:31.501183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:31.501183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:31.501183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 269/524] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:31.502330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe358c-3f18-4464-b8b9-fcbaae656b42 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:31.511197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d722a63-010b-42c5-b226-6183d842a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:31.511883 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722a63-010b-42c5-b226-6183d842a601 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:31.512169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722a63-010b-42c5-b226-6183d842a601 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:31.512443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722a63-010b-42c5-b226-6183d842a601 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:31.513310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d722a63-010b-42c5-b226-6183d842a601 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:31.513619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d722a63-010b-42c5-b226-6183d842a601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:31.515048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d722a63-010b-42c5-b226-6183d842a601 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:31.515830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:31.536932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 256/525] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Jun 17 14:59:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:31.538374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d722a63-010b-42c5-b226-6183d842a601 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:31.620966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe358c-3f18-4464-b8b9-fcbaae656b42 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:31.664056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5d489-b832-4b1c-a7aa-2b656fbd6fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:31.664709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5d489-b832-4b1c-a7aa-2b656fbd6fcd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:31.665026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5d489-b832-4b1c-a7aa-2b656fbd6fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:31.665389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5d489-b832-4b1c-a7aa-2b656fbd6fcd None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:31.666513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5d489-b832-4b1c-a7aa-2b656fbd6fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:31.666881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5d489-b832-4b1c-a7aa-2b656fbd6fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:31.668312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5d489-b832-4b1c-a7aa-2b656fbd6fcd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:31.673698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d722a63-010b-42c5-b226-6183d842a601 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:31.680523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 270/526] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:31.681389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5d489-b832-4b1c-a7aa-2b656fbd6fcd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:31.686651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:31.714411 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf379559-1b58-4d34-bb52-5471cb5fef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:31.715134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf379559-1b58-4d34-bb52-5471cb5fef5b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:31.715424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf379559-1b58-4d34-bb52-5471cb5fef5b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:31.715700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf379559-1b58-4d34-bb52-5471cb5fef5b None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:31.716463 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf379559-1b58-4d34-bb52-5471cb5fef5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:31.716770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf379559-1b58-4d34-bb52-5471cb5fef5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:31.718248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf379559-1b58-4d34-bb52-5471cb5fef5b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:31.731027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 257/527] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:31.731696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf379559-1b58-4d34-bb52-5471cb5fef5b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:31.765493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:31.807354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5d489-b832-4b1c-a7aa-2b656fbd6fcd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:31.849292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf379559-1b58-4d34-bb52-5471cb5fef5b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:31.855379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b75c26-0d48-4aac-9881-79188c6b8b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:31.856136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b75c26-0d48-4aac-9881-79188c6b8b00 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:31.856418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b75c26-0d48-4aac-9881-79188c6b8b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:31.856691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b75c26-0d48-4aac-9881-79188c6b8b00 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:31.857591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b75c26-0d48-4aac-9881-79188c6b8b00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:31.857905 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b75c26-0d48-4aac-9881-79188c6b8b00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:31.859480 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b75c26-0d48-4aac-9881-79188c6b8b00 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:31.880216 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 271/528] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:31.881655 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b75c26-0d48-4aac-9881-79188c6b8b00 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:31.899218 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614429e-13a2-40a7-9c60-2d77a333c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:31.900501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614429e-13a2-40a7-9c60-2d77a333c207 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:31.901555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614429e-13a2-40a7-9c60-2d77a333c207 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:31.901990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614429e-13a2-40a7-9c60-2d77a333c207 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:31.946759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:31.985481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614429e-13a2-40a7-9c60-2d77a333c207 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:31.987158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614429e-13a2-40a7-9c60-2d77a333c207 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:31.994023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b75c26-0d48-4aac-9881-79188c6b8b00 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:32.036414 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:32.054117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c616c45-5214-47d6-bc6d-7b1163c1ec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:32.054877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616c45-5214-47d6-bc6d-7b1163c1ec9e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:32.055157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616c45-5214-47d6-bc6d-7b1163c1ec9e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:32.055427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616c45-5214-47d6-bc6d-7b1163c1ec9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:32.063296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c616c45-5214-47d6-bc6d-7b1163c1ec9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:32.064833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c616c45-5214-47d6-bc6d-7b1163c1ec9e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7c616c45-5214-47d6-bc6d-7b1163c1ec9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:32.080944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:32.081949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:32.088606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:32.088606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:32.088606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:32.088606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:32.088606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:32.088606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:32.088606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:32.088606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:32.088606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 272/529] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:32.088606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c616c45-5214-47d6-bc6d-7b1163c1ec9e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:32.128558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 258/530] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:32.129813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614429e-13a2-40a7-9c60-2d77a333c207 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:32.214243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c616c45-5214-47d6-bc6d-7b1163c1ec9e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:32.215991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:32.250888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614429e-13a2-40a7-9c60-2d77a333c207 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:32.269051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab15bf8-3eba-4e71-ad6d-bb6bccaf5f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:32.269975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab15bf8-3eba-4e71-ad6d-bb6bccaf5f6b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:32.270313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab15bf8-3eba-4e71-ad6d-bb6bccaf5f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:32.270642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab15bf8-3eba-4e71-ad6d-bb6bccaf5f6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:32.278141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab15bf8-3eba-4e71-ad6d-bb6bccaf5f6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:32.279608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab15bf8-3eba-4e71-ad6d-bb6bccaf5f6b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:32.287901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc4cc-e016-49a7-af6c-b1751d7e3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:32.288561 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc4cc-e016-49a7-af6c-b1751d7e3e0c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:32.288839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc4cc-e016-49a7-af6c-b1751d7e3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:32.289114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc4cc-e016-49a7-af6c-b1751d7e3e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:32.289988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55dc4cc-e016-49a7-af6c-b1751d7e3e0c None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=d8b74d07fba34715a488539d630b0bd0) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:32.290292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55dc4cc-e016-49a7-af6c-b1751d7e3e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:32.291911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55dc4cc-e016-49a7-af6c-b1751d7e3e0c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-dab15bf8-3eba-4e71-ad6d-bb6bccaf5f6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:32.295065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:32.296117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:32.297989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:32.297989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:32.297989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:32.297989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:32.297989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:32.297989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:32.297989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:32.297989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:32.297989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 273/531] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:32.298449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab15bf8-3eba-4e71-ad6d-bb6bccaf5f6b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:32.302021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 259/532] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:32 2022] GET /identity/v3/role_assignments?user.id=d8b74d07fba34715a488539d630b0bd0&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:32.302890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc4cc-e016-49a7-af6c-b1751d7e3e0c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:32.368264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:32.431247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc4cc-e016-49a7-af6c-b1751d7e3e0c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:32.444955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab15bf8-3eba-4e71-ad6d-bb6bccaf5f6b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:32.478988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3aa9a4-87d7-472f-a8fc-848c628d397c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:32.480801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3aa9a4-87d7-472f-a8fc-848c628d397c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:32.482228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3aa9a4-87d7-472f-a8fc-848c628d397c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:32.482908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3aa9a4-87d7-472f-a8fc-848c628d397c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:32.486547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:32.502114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3aa9a4-87d7-472f-a8fc-848c628d397c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:32.503627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3aa9a4-87d7-472f-a8fc-848c628d397c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:32.506476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf4750-f2ef-4f7c-a65b-46c4a38e9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:32.507220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4750-f2ef-4f7c-a65b-46c4a38e9806 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:32.507559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4750-f2ef-4f7c-a65b-46c4a38e9806 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:32.507896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4750-f2ef-4f7c-a65b-46c4a38e9806 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:32.508753 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf4750-f2ef-4f7c-a65b-46c4a38e9806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:32.509122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf4750-f2ef-4f7c-a65b-46c4a38e9806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:32.510805 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf4750-f2ef-4f7c-a65b-46c4a38e9806 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:32.523983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 274/533] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:32.525286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf4750-f2ef-4f7c-a65b-46c4a38e9806 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-eb3aa9a4-87d7-472f-a8fc-848c628d397c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:32.526472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:32.527307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:32.528137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:32.528137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:32.528137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:32.528137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:32.530895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 260/534] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:32.531901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3aa9a4-87d7-472f-a8fc-848c628d397c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:32.634897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf4750-f2ef-4f7c-a65b-46c4a38e9806 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:32.646456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:32.670084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3aa9a4-87d7-472f-a8fc-848c628d397c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:32.674465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd97283-6893-4001-8275-d3409c0664dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:32.675347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd97283-6893-4001-8275-d3409c0664dc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:32.675772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd97283-6893-4001-8275-d3409c0664dc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:32.676183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd97283-6893-4001-8275-d3409c0664dc None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:32.677128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd97283-6893-4001-8275-d3409c0664dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:32.677616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd97283-6893-4001-8275-d3409c0664dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:32.679754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd97283-6893-4001-8275-d3409c0664dc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:32.697415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 275/535] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:32.698978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd97283-6893-4001-8275-d3409c0664dc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:32.723678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9ac41-dabe-4abb-90eb-790eeb5d8841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:32.724739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9ac41-dabe-4abb-90eb-790eeb5d8841 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:32.725115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9ac41-dabe-4abb-90eb-790eeb5d8841 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:32.725511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9ac41-dabe-4abb-90eb-790eeb5d8841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:32.726780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9ac41-dabe-4abb-90eb-790eeb5d8841 None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=ca11a9d339bb4e799dc4e5531147ddda) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:32.727791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9ac41-dabe-4abb-90eb-790eeb5d8841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:32.730045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9ac41-dabe-4abb-90eb-790eeb5d8841 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:32.739951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 261/536] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:32 2022] GET /identity/v3/role_assignments?user.id=ca11a9d339bb4e799dc4e5531147ddda&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:32.741094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9ac41-dabe-4abb-90eb-790eeb5d8841 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:32.801163 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:32.859711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd97283-6893-4001-8275-d3409c0664dc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:32.864918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9ac41-dabe-4abb-90eb-790eeb5d8841 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:32.910675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b83a6e-04cf-4f09-b17d-a4e7d41c0d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:32.911631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1a23-9759-4014-883e-45a7334888b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:32.912913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1a23-9759-4014-883e-45a7334888b3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:32.913522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83a6e-04cf-4f09-b17d-a4e7d41c0d3b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:32.913964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83a6e-04cf-4f09-b17d-a4e7d41c0d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:32.914404 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1a23-9759-4014-883e-45a7334888b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:32.914825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83a6e-04cf-4f09-b17d-a4e7d41c0d3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:32.915247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1a23-9759-4014-883e-45a7334888b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:32.916382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b83a6e-04cf-4f09-b17d-a4e7d41c0d3b None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=b9cc8b94e9ba470ca1f620b7cbed8e5b) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:32.917405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c1a23-9759-4014-883e-45a7334888b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:32.917870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c1a23-9759-4014-883e-45a7334888b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:32.918353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b83a6e-04cf-4f09-b17d-a4e7d41c0d3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:32.919915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c1a23-9759-4014-883e-45a7334888b3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:32.921661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b83a6e-04cf-4f09-b17d-a4e7d41c0d3b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:32.933640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 262/537] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:32 2022] GET /identity/v3/role_assignments?user.id=b9cc8b94e9ba470ca1f620b7cbed8e5b&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:32.947935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 276/538] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:32.953748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b83a6e-04cf-4f09-b17d-a4e7d41c0d3b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:33.102390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b83a6e-04cf-4f09-b17d-a4e7d41c0d3b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:33.118677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:33.147853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df7aa-3b2b-4f38-871b-2c9b9de7743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:33.148670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df7aa-3b2b-4f38-871b-2c9b9de7743e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:33.148955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df7aa-3b2b-4f38-871b-2c9b9de7743e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:33.149258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df7aa-3b2b-4f38-871b-2c9b9de7743e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:33.157198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4df7aa-3b2b-4f38-871b-2c9b9de7743e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:33.158698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4df7aa-3b2b-4f38-871b-2c9b9de7743e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ca4df7aa-3b2b-4f38-871b-2c9b9de7743e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:33.174797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:33.175735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:33.176603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:33.176603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:33.176603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:33.176603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:33.176603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:33.176603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:33.176603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:33.176603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:33.180603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 263/539] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:33.182075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1a23-9759-4014-883e-45a7334888b3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:33.235723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:33.326569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1a23-9759-4014-883e-45a7334888b3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:33.368638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dae299-db05-42ee-99ee-914b597fd91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:33.369415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dae299-db05-42ee-99ee-914b597fd91f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:33.369690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dae299-db05-42ee-99ee-914b597fd91f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:33.369953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dae299-db05-42ee-99ee-914b597fd91f None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:33.370732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dae299-db05-42ee-99ee-914b597fd91f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:33.371035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dae299-db05-42ee-99ee-914b597fd91f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:33.372483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dae299-db05-42ee-99ee-914b597fd91f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:33.390449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 277/540] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:33.396137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df7aa-3b2b-4f38-871b-2c9b9de7743e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:33.547223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df7aa-3b2b-4f38-871b-2c9b9de7743e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:33.584057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f877b3-ddb5-4d65-8d2b-1ea4d2db1ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:33.584716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f877b3-ddb5-4d65-8d2b-1ea4d2db1ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:33.585000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f877b3-ddb5-4d65-8d2b-1ea4d2db1ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:33.585306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f877b3-ddb5-4d65-8d2b-1ea4d2db1ef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:33.586145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f877b3-ddb5-4d65-8d2b-1ea4d2db1ef9 None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=20745118f9eb436096a323ba2d22e94f) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:33.586458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f877b3-ddb5-4d65-8d2b-1ea4d2db1ef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:33.587947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f877b3-ddb5-4d65-8d2b-1ea4d2db1ef9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:33.601354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 264/541] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:33 2022] GET /identity/v3/role_assignments?user.id=20745118f9eb436096a323ba2d22e94f&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:33.636738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17762b1-7928-412a-9a7b-fa41b12baf72 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:33.637342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17762b1-7928-412a-9a7b-fa41b12baf72 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:33.637342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17762b1-7928-412a-9a7b-fa41b12baf72 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:33.639012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 278/542] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:33.660025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee570a4-5b99-4886-bda2-f9d7934f4401 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:33.660420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee570a4-5b99-4886-bda2-f9d7934f4401 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:33.660611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee570a4-5b99-4886-bda2-f9d7934f4401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:33.682940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7ee570a4-5b99-4886-bda2-f9d7934f4401 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:33.684189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7ee570a4-5b99-4886-bda2-f9d7934f4401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:33.729534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:33.787490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 265/543] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:33.819754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17762b1-7928-412a-9a7b-fa41b12baf72 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:33.947053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:33.960306 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17762b1-7928-412a-9a7b-fa41b12baf72 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:33.998012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2447-47bb-400d-8bda-7aab48a2ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:33.999171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2447-47bb-400d-8bda-7aab48a2ba2f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:33.999669 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2447-47bb-400d-8bda-7aab48a2ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:34.000138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2447-47bb-400d-8bda-7aab48a2ba2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:34.011586 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc2447-47bb-400d-8bda-7aab48a2ba2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c5fc2447-47bb-400d-8bda-7aab48a2ba2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:34.019733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:34.020652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:34.021450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:34.024225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 279/544] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:34.029950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee570a4-5b99-4886-bda2-f9d7934f4401 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:34.204163 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee570a4-5b99-4886-bda2-f9d7934f4401 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:34.258287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97dbb8-0ca2-4ecd-a6c3-1882d5ca7d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:34.259031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97dbb8-0ca2-4ecd-a6c3-1882d5ca7d77 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:34.259314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97dbb8-0ca2-4ecd-a6c3-1882d5ca7d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:34.259658 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97dbb8-0ca2-4ecd-a6c3-1882d5ca7d77 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:34.260543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97dbb8-0ca2-4ecd-a6c3-1882d5ca7d77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:34.260852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97dbb8-0ca2-4ecd-a6c3-1882d5ca7d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:34.262281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97dbb8-0ca2-4ecd-a6c3-1882d5ca7d77 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:34.275496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 266/545] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:34.280876 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2447-47bb-400d-8bda-7aab48a2ba2f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:34.405114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2447-47bb-400d-8bda-7aab48a2ba2f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:34.441068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c83e01-443b-47d2-b2c9-7e89f11fad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:34.442155 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c83e01-443b-47d2-b2c9-7e89f11fad6d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:34.442591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c83e01-443b-47d2-b2c9-7e89f11fad6d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:34.443010 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c83e01-443b-47d2-b2c9-7e89f11fad6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:34.455601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c83e01-443b-47d2-b2c9-7e89f11fad6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:34.457314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c83e01-443b-47d2-b2c9-7e89f11fad6d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-00c83e01-443b-47d2-b2c9-7e89f11fad6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:34.477453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:34.478894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:34.480007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:34.480007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:34.480007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:34.480007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:34.482145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 280/546] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:34.489242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97dbb8-0ca2-4ecd-a6c3-1882d5ca7d77 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:34.554648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:34.644133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97dbb8-0ca2-4ecd-a6c3-1882d5ca7d77 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:34.700457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505f869-d2f1-44e9-8052-ba3593851876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:34.701887 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f869-d2f1-44e9-8052-ba3593851876 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:34.702412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f869-d2f1-44e9-8052-ba3593851876 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:34.702936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f869-d2f1-44e9-8052-ba3593851876 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:34.704393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505f869-d2f1-44e9-8052-ba3593851876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:34.705056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505f869-d2f1-44e9-8052-ba3593851876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:34.708028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505f869-d2f1-44e9-8052-ba3593851876 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:34.733016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 267/547] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:34.738326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c83e01-443b-47d2-b2c9-7e89f11fad6d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:34.744068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:34.893928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c83e01-443b-47d2-b2c9-7e89f11fad6d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:34.929642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5caa-ea72-4249-b5d6-a1e1e9994b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:34.930709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5caa-ea72-4249-b5d6-a1e1e9994b37 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:34.931136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5caa-ea72-4249-b5d6-a1e1e9994b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:34.931730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5caa-ea72-4249-b5d6-a1e1e9994b37 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:34.941008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5caa-ea72-4249-b5d6-a1e1e9994b37 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:34.942736 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5caa-ea72-4249-b5d6-a1e1e9994b37 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d81a5caa-ea72-4249-b5d6-a1e1e9994b37 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:34.959103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:34.960703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:34.962007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:34.962007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:34.962007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:34.962007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:34.962007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:34.962007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:34.962007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:34.962007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:34.962007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 14:59:34.962007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:34.967705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 281/548] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:59:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:34.977154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505f869-d2f1-44e9-8052-ba3593851876 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:35.119624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:35.130906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505f869-d2f1-44e9-8052-ba3593851876 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:35.183563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901be4e-d17c-4632-92b9-325a488cc0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:35.184465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901be4e-d17c-4632-92b9-325a488cc0bc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.184770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901be4e-d17c-4632-92b9-325a488cc0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.185118 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901be4e-d17c-4632-92b9-325a488cc0bc None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.186208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901be4e-d17c-4632-92b9-325a488cc0bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:35.186515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901be4e-d17c-4632-92b9-325a488cc0bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:35.188033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901be4e-d17c-4632-92b9-325a488cc0bc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:35.219767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 268/549] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 17 14:59:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:35.225141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5caa-ea72-4249-b5d6-a1e1e9994b37 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:35.250095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3593404-58b5-4589-bb82-71be178c2d29 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.250432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3593404-58b5-4589-bb82-71be178c2d29 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.250655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3593404-58b5-4589-bb82-71be178c2d29 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.252354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 269/550] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:59:35.257457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e3035-b4c9-4b54-98fd-3dba6f400357 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.257746 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e3035-b4c9-4b54-98fd-3dba6f400357 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.258030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e3035-b4c9-4b54-98fd-3dba6f400357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.275780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d47e3035-b4c9-4b54-98fd-3dba6f400357 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:35.277030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d47e3035-b4c9-4b54-98fd-3dba6f400357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:35.299930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:35.342639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5caa-ea72-4249-b5d6-a1e1e9994b37 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:35.378016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d281-818a-4c24-8c48-6b90806d7aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:35.378828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d281-818a-4c24-8c48-6b90806d7aea None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.379227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d281-818a-4c24-8c48-6b90806d7aea None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.379489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d281-818a-4c24-8c48-6b90806d7aea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.408338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 270/551] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:35.449111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e3035-b4c9-4b54-98fd-3dba6f400357 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:35.451842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565d281-818a-4c24-8c48-6b90806d7aea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:35.453763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565d281-818a-4c24-8c48-6b90806d7aea None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:35.518507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:35.569239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 282/552] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:35.570547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d281-818a-4c24-8c48-6b90806d7aea None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:35.625284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:35.654231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e3035-b4c9-4b54-98fd-3dba6f400357 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:35.700766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17268072-d3aa-4a0a-a92a-beb17ccf7911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:35.701608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d281-818a-4c24-8c48-6b90806d7aea None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:35.701948 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17268072-d3aa-4a0a-a92a-beb17ccf7911 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.702274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17268072-d3aa-4a0a-a92a-beb17ccf7911 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.702556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17268072-d3aa-4a0a-a92a-beb17ccf7911 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.715033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17268072-d3aa-4a0a-a92a-beb17ccf7911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-17268072-d3aa-4a0a-a92a-beb17ccf7911 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:35.722821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:35.723838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:35.724639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 271/553] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:35.725346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5b183-80a4-487a-8c48-2563aa008af6 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.725909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5b183-80a4-487a-8c48-2563aa008af6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.725909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5b183-80a4-487a-8c48-2563aa008af6 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.727057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 272/554] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:35.728103 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc66b5-2cc0-429a-930f-bf081bd2f78f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.728497 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc66b5-2cc0-429a-930f-bf081bd2f78f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.728813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc66b5-2cc0-429a-930f-bf081bd2f78f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.733256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 273/555] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:35.735388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc66b5-2cc0-429a-930f-bf081bd2f78f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:35.749328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4daf6-b32b-4f0f-a108-d14e37ad37fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:35.750018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4daf6-b32b-4f0f-a108-d14e37ad37fb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.750297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4daf6-b32b-4f0f-a108-d14e37ad37fb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.750731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4daf6-b32b-4f0f-a108-d14e37ad37fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.761124 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4daf6-b32b-4f0f-a108-d14e37ad37fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:35.762632 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4daf6-b32b-4f0f-a108-d14e37ad37fb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-79a4daf6-b32b-4f0f-a108-d14e37ad37fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:35.780505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:35.781462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:35.782338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:35.782338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:35.782338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:35.782338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:35.786660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 283/556] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:35.788340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96fb8f-0c64-4fb0-b649-4e5591c210c2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.788475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96fb8f-0c64-4fb0-b649-4e5591c210c2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.788711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96fb8f-0c64-4fb0-b649-4e5591c210c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.805825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4a96fb8f-0c64-4fb0-b649-4e5591c210c2 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:35.807161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4a96fb8f-0c64-4fb0-b649-4e5591c210c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:35.817697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:35.864377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc66b5-2cc0-429a-930f-bf081bd2f78f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:35.882311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 284/557] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:35.884049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c0623-75b3-4994-810d-b978125b77a6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.884331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c0623-75b3-4994-810d-b978125b77a6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.884690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c0623-75b3-4994-810d-b978125b77a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.905855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b89c0623-75b3-4994-810d-b978125b77a6 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:35.907398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b89c0623-75b3-4994-810d-b978125b77a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:35.914908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02cd08-148f-4448-a116-795cdce48c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:35.915766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02cd08-148f-4448-a116-795cdce48c10 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:35.916744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02cd08-148f-4448-a116-795cdce48c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:35.917028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02cd08-148f-4448-a116-795cdce48c10 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:35.917879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02cd08-148f-4448-a116-795cdce48c10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:35.918185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02cd08-148f-4448-a116-795cdce48c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:35.919618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02cd08-148f-4448-a116-795cdce48c10 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:35.925692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:35.934810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 274/558] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:35.935797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02cd08-148f-4448-a116-795cdce48c10 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:35.984954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 285/559] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:35.986134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c0623-75b3-4994-810d-b978125b77a6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.063832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02cd08-148f-4448-a116-795cdce48c10 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.088980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:36.105801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec685f9-3374-4862-b97a-6c9a79b5a692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:36.106621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec685f9-3374-4862-b97a-6c9a79b5a692 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.106903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec685f9-3374-4862-b97a-6c9a79b5a692 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.107182 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec685f9-3374-4862-b97a-6c9a79b5a692 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.107915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec685f9-3374-4862-b97a-6c9a79b5a692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:36.108215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec685f9-3374-4862-b97a-6c9a79b5a692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:36.109641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec685f9-3374-4862-b97a-6c9a79b5a692 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:36.118646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c0623-75b3-4994-810d-b978125b77a6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.122852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 275/560] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:36.124061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec685f9-3374-4862-b97a-6c9a79b5a692 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.164975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72434d9f-f1e8-4a3d-92fb-d950b1a8ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:36.165901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72434d9f-f1e8-4a3d-92fb-d950b1a8ee0f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.166877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72434d9f-f1e8-4a3d-92fb-d950b1a8ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.167156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72434d9f-f1e8-4a3d-92fb-d950b1a8ee0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.180932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72434d9f-f1e8-4a3d-92fb-d950b1a8ee0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-72434d9f-f1e8-4a3d-92fb-d950b1a8ee0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:36.189487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:36.190580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:36.191483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 286/561] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:36.192147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72434d9f-f1e8-4a3d-92fb-d950b1a8ee0f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.226404 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:36.273841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec685f9-3374-4862-b97a-6c9a79b5a692 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.312106 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64faa7-5c0f-46ff-afc5-032e255ce892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:36.312905 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64faa7-5c0f-46ff-afc5-032e255ce892 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.313181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64faa7-5c0f-46ff-afc5-032e255ce892 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.313488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64faa7-5c0f-46ff-afc5-032e255ce892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.319701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72434d9f-f1e8-4a3d-92fb-d950b1a8ee0f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.325506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64faa7-5c0f-46ff-afc5-032e255ce892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:36.327299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64faa7-5c0f-46ff-afc5-032e255ce892 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7b64faa7-5c0f-46ff-afc5-032e255ce892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:36.344615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:36.345744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:36.346603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:36.346603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:36.346603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:36.346603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:36.346603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 276/562] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:36.347353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64faa7-5c0f-46ff-afc5-032e255ce892 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.359930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd8a2-dbd2-46d5-901f-bae9f47d70a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:36.360735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd8a2-dbd2-46d5-901f-bae9f47d70a1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.361011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd8a2-dbd2-46d5-901f-bae9f47d70a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.361314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd8a2-dbd2-46d5-901f-bae9f47d70a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.363255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:36.375179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afd8a2-dbd2-46d5-901f-bae9f47d70a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-08afd8a2-dbd2-46d5-901f-bae9f47d70a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:36.383050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:36.383982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:36.385111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 287/563] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:36.385826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd8a2-dbd2-46d5-901f-bae9f47d70a1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.468964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64faa7-5c0f-46ff-afc5-032e255ce892 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.483842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:36.498520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd8a2-dbd2-46d5-901f-bae9f47d70a1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.511948 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26f2e-24cf-4fe5-8cfe-284816a6d301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:36.512765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26f2e-24cf-4fe5-8cfe-284816a6d301 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.513048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26f2e-24cf-4fe5-8cfe-284816a6d301 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.513361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26f2e-24cf-4fe5-8cfe-284816a6d301 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.521783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c26f2e-24cf-4fe5-8cfe-284816a6d301 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:36.524048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c26f2e-24cf-4fe5-8cfe-284816a6d301 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:36.539367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa40df6-377f-4aa9-a09b-42e925b81bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e0c26f2e-24cf-4fe5-8cfe-284816a6d301 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:36.540062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:36.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:36.542026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:36.542026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:36.542026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:36.542026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:36.542026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:36.542026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:36.542026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:36.542026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:36.542444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa40df6-377f-4aa9-a09b-42e925b81bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.542444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa40df6-377f-4aa9-a09b-42e925b81bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.542444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa40df6-377f-4aa9-a09b-42e925b81bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.542444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa40df6-377f-4aa9-a09b-42e925b81bb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:36.542711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 277/564] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:36.542784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa40df6-377f-4aa9-a09b-42e925b81bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:36.542856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26f2e-24cf-4fe5-8cfe-284816a6d301 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.543772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa40df6-377f-4aa9-a09b-42e925b81bb4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:36.557459 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 288/565] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:36.557459 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa40df6-377f-4aa9-a09b-42e925b81bb4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.615980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:36.652921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26f2e-24cf-4fe5-8cfe-284816a6d301 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.660804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa40df6-377f-4aa9-a09b-42e925b81bb4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.687197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a87522-2d98-4d28-b0c7-3065727b0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:36.687866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a87522-2d98-4d28-b0c7-3065727b0723 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.688143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a87522-2d98-4d28-b0c7-3065727b0723 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.688417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a87522-2d98-4d28-b0c7-3065727b0723 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.689136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a87522-2d98-4d28-b0c7-3065727b0723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:36.689471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a87522-2d98-4d28-b0c7-3065727b0723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:36.690851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a87522-2d98-4d28-b0c7-3065727b0723 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:36.695211 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1893c3-c70c-4164-be9e-259fbc0a306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:36.695879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1893c3-c70c-4164-be9e-259fbc0a306b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.696158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1893c3-c70c-4164-be9e-259fbc0a306b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.696434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1893c3-c70c-4164-be9e-259fbc0a306b None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.697371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1893c3-c70c-4164-be9e-259fbc0a306b None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:36.697858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1893c3-c70c-4164-be9e-259fbc0a306b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:36.699308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1893c3-c70c-4164-be9e-259fbc0a306b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:36.702702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 278/566] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:36.703519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a87522-2d98-4d28-b0c7-3065727b0723 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.707905 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 289/567] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:36.708702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1893c3-c70c-4164-be9e-259fbc0a306b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.741841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:36.812826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a87522-2d98-4d28-b0c7-3065727b0723 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.813074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1893c3-c70c-4164-be9e-259fbc0a306b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.831154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:36.848506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f019c3-9242-4aed-b4b2-a0f7ea69b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:36.848751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58daba-09ec-4c06-a8a6-ac6670248f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:36.849200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f019c3-9242-4aed-b4b2-a0f7ea69b799 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.849455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58daba-09ec-4c06-a8a6-ac6670248f8f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.849545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f019c3-9242-4aed-b4b2-a0f7ea69b799 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.849738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58daba-09ec-4c06-a8a6-ac6670248f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.849849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f019c3-9242-4aed-b4b2-a0f7ea69b799 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.850015 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58daba-09ec-4c06-a8a6-ac6670248f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.850578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f019c3-9242-4aed-b4b2-a0f7ea69b799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:36.850892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f019c3-9242-4aed-b4b2-a0f7ea69b799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:36.852388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f019c3-9242-4aed-b4b2-a0f7ea69b799 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:36.861066 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58daba-09ec-4c06-a8a6-ac6670248f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:36.862592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58daba-09ec-4c06-a8a6-ac6670248f8f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:36.870906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 279/568] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:36.872173 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c309655-5db1-4cea-a60f-5a272a5ca644 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:36.872454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c309655-5db1-4cea-a60f-5a272a5ca644 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:36.872729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c309655-5db1-4cea-a60f-5a272a5ca644 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:36.876225 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 280/569] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:36.876225 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c309655-5db1-4cea-a60f-5a272a5ca644 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1a58daba-09ec-4c06-a8a6-ac6670248f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:36.880954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:36.882012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:36.883102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:36.883102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:36.883102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:36.883102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:36.885567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 290/570] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:36.886290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58daba-09ec-4c06-a8a6-ac6670248f8f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:36.972523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:36.984089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c309655-5db1-4cea-a60f-5a272a5ca644 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:36.987438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58daba-09ec-4c06-a8a6-ac6670248f8f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:37.018248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd8edc-158b-4d77-81cd-c6db15a44657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.019039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd8edc-158b-4d77-81cd-c6db15a44657 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.019311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd8edc-158b-4d77-81cd-c6db15a44657 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.019583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd8edc-158b-4d77-81cd-c6db15a44657 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.022064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47699f03-caf2-479c-804f-676e2377742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.023359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47699f03-caf2-479c-804f-676e2377742c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.023641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47699f03-caf2-479c-804f-676e2377742c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.023915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47699f03-caf2-479c-804f-676e2377742c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.027203 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd8edc-158b-4d77-81cd-c6db15a44657 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:37.028659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd8edc-158b-4d77-81cd-c6db15a44657 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:37.034935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47699f03-caf2-479c-804f-676e2377742c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:37.036365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47699f03-caf2-479c-804f-676e2377742c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-98dd8edc-158b-4d77-81cd-c6db15a44657 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:37.043129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:37.044143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 281/571] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:37.045119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd8edc-158b-4d77-81cd-c6db15a44657 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-47699f03-caf2-479c-804f-676e2377742c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:37.058259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:37.059400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:37.060406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:37.060406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:37.060406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:37.060406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:37.060406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 291/572] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:37.062080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0087b5-d963-43e8-8da1-3e124e50da2a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.062365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0087b5-d963-43e8-8da1-3e124e50da2a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.062965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0087b5-d963-43e8-8da1-3e124e50da2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.080791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8c0087b5-d963-43e8-8da1-3e124e50da2a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:37.082047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8c0087b5-d963-43e8-8da1-3e124e50da2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:37.098812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:37.149125 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 292/573] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:37.150047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0087b5-d963-43e8-8da1-3e124e50da2a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:37.150573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd8edc-158b-4d77-81cd-c6db15a44657 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:37.187467 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b1af-7b0a-4ac5-9000-700e2d0df14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.188126 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b1af-7b0a-4ac5-9000-700e2d0df14a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.188408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b1af-7b0a-4ac5-9000-700e2d0df14a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.188687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b1af-7b0a-4ac5-9000-700e2d0df14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.189590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9b1af-7b0a-4ac5-9000-700e2d0df14a None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=34feb70a340c4fc5b1fad510328c009b) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:37.189905 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9b1af-7b0a-4ac5-9000-700e2d0df14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:37.191342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9b1af-7b0a-4ac5-9000-700e2d0df14a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:37.196775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 282/574] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/role_assignments?user.id=34feb70a340c4fc5b1fad510328c009b&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:37.198005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b1af-7b0a-4ac5-9000-700e2d0df14a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:37.219181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:37.272824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0087b5-d963-43e8-8da1-3e124e50da2a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:37.311856 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea2741-d108-4583-b0ea-92cee817f6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.312837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2741-d108-4583-b0ea-92cee817f6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.313118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2741-d108-4583-b0ea-92cee817f6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.313430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2741-d108-4583-b0ea-92cee817f6b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.314212 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea2741-d108-4583-b0ea-92cee817f6b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:37.314521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea2741-d108-4583-b0ea-92cee817f6b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:37.315957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea2741-d108-4583-b0ea-92cee817f6b2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:37.326627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b1af-7b0a-4ac5-9000-700e2d0df14a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:37.334191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 293/575] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:37.334191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea2741-d108-4583-b0ea-92cee817f6b2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:37.347675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:37.376228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60122b9-54a7-4344-af2d-256c727747de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.376920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60122b9-54a7-4344-af2d-256c727747de None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.377232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60122b9-54a7-4344-af2d-256c727747de None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.377504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60122b9-54a7-4344-af2d-256c727747de None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.378362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60122b9-54a7-4344-af2d-256c727747de None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:37.378671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60122b9-54a7-4344-af2d-256c727747de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:37.380137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60122b9-54a7-4344-af2d-256c727747de None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:37.400013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 283/576] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:37.400869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60122b9-54a7-4344-af2d-256c727747de None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:37.453585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea2741-d108-4583-b0ea-92cee817f6b2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:37.486112 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:37.492345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06394-44fb-4167-82ed-3994744273b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.493318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06394-44fb-4167-82ed-3994744273b3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.493600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06394-44fb-4167-82ed-3994744273b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.493903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06394-44fb-4167-82ed-3994744273b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.494693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a06394-44fb-4167-82ed-3994744273b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:37.495173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a06394-44fb-4167-82ed-3994744273b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:37.496619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a06394-44fb-4167-82ed-3994744273b3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:37.508967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 294/577] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:37.509945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06394-44fb-4167-82ed-3994744273b3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:37.520894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60122b9-54a7-4344-af2d-256c727747de None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:37.558219 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b8a37-bb3f-4b40-9db2-064288a4a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.559178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8a37-bb3f-4b40-9db2-064288a4a28c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.559589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8a37-bb3f-4b40-9db2-064288a4a28c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.559913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8a37-bb3f-4b40-9db2-064288a4a28c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.571348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b8a37-bb3f-4b40-9db2-064288a4a28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8f9b8a37-bb3f-4b40-9db2-064288a4a28c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:37.579768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:37.580895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:37.581880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 284/578] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:37.582553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b8a37-bb3f-4b40-9db2-064288a4a28c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:37.596359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:37.630236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06394-44fb-4167-82ed-3994744273b3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:37.668627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584e96d-af7a-4b44-94f6-2d14f234a959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.669509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584e96d-af7a-4b44-94f6-2d14f234a959 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.669784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584e96d-af7a-4b44-94f6-2d14f234a959 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.670056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584e96d-af7a-4b44-94f6-2d14f234a959 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.678871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584e96d-af7a-4b44-94f6-2d14f234a959 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:37.680345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584e96d-af7a-4b44-94f6-2d14f234a959 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d584e96d-af7a-4b44-94f6-2d14f234a959 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:37.696629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:37.697877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:37.698888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:37.698888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:37.698888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:37.698888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:37.698888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:37.698888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:37.698888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:37.698888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:37.698888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 14:59:37.698888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:37.703277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 295/579] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:37.704301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584e96d-af7a-4b44-94f6-2d14f234a959 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:37.704408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b8a37-bb3f-4b40-9db2-064288a4a28c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:37.744665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914d6cb-7d41-4dff-9ac7-1e46371a180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.746155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914d6cb-7d41-4dff-9ac7-1e46371a180d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.746439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914d6cb-7d41-4dff-9ac7-1e46371a180d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.746715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914d6cb-7d41-4dff-9ac7-1e46371a180d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.748946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:37.760338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914d6cb-7d41-4dff-9ac7-1e46371a180d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:37.761825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914d6cb-7d41-4dff-9ac7-1e46371a180d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5914d6cb-7d41-4dff-9ac7-1e46371a180d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:37.780095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:37.781044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:37.781966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:37.781966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:37.781966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:37.781966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:37.786122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 285/580] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:37.789120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914d6cb-7d41-4dff-9ac7-1e46371a180d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:37.824415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584e96d-af7a-4b44-94f6-2d14f234a959 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:37.857442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:37.864485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74888a0a-745a-4ec2-a268-edcc0dbc45ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.865455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74888a0a-745a-4ec2-a268-edcc0dbc45ac None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.865839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74888a0a-745a-4ec2-a268-edcc0dbc45ac None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.866200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74888a0a-745a-4ec2-a268-edcc0dbc45ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.875530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74888a0a-745a-4ec2-a268-edcc0dbc45ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:37.876991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74888a0a-745a-4ec2-a268-edcc0dbc45ac None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-74888a0a-745a-4ec2-a268-edcc0dbc45ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:37.892039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:37.893183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:37.894144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 296/581] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:37.894729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74888a0a-745a-4ec2-a268-edcc0dbc45ac None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:37.904242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914d6cb-7d41-4dff-9ac7-1e46371a180d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:37.941737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892f49-7b3d-465a-a8c4-0294b5b82811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:37.942871 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892f49-7b3d-465a-a8c4-0294b5b82811 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:37.943291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892f49-7b3d-465a-a8c4-0294b5b82811 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:37.943877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892f49-7b3d-465a-a8c4-0294b5b82811 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:37.945138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c892f49-7b3d-465a-a8c4-0294b5b82811 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:37.945865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c892f49-7b3d-465a-a8c4-0294b5b82811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:37.947579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c892f49-7b3d-465a-a8c4-0294b5b82811 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:37.959693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 286/582] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:37.960800 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892f49-7b3d-465a-a8c4-0294b5b82811 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.006423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74888a0a-745a-4ec2-a268-edcc0dbc45ac None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:38.020539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:38.043743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad10b3-3ab1-4e45-aa14-925213226d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:38.045248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad10b3-3ab1-4e45-aa14-925213226d75 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:38.045248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad10b3-3ab1-4e45-aa14-925213226d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:38.045248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad10b3-3ab1-4e45-aa14-925213226d75 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:38.045941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad10b3-3ab1-4e45-aa14-925213226d75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:38.046255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad10b3-3ab1-4e45-aa14-925213226d75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:38.047791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad10b3-3ab1-4e45-aa14-925213226d75 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:38.072105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 297/583] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:38.072105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad10b3-3ab1-4e45-aa14-925213226d75 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.088466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892f49-7b3d-465a-a8c4-0294b5b82811 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:38.126432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ae32-48a4-4f1b-9e5f-bad65231b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:38.127105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ae32-48a4-4f1b-9e5f-bad65231b596 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:38.127383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ae32-48a4-4f1b-9e5f-bad65231b596 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:38.127665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ae32-48a4-4f1b-9e5f-bad65231b596 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:38.128418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ae32-48a4-4f1b-9e5f-bad65231b596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:38.128780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ae32-48a4-4f1b-9e5f-bad65231b596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:38.129680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:38.130713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ae32-48a4-4f1b-9e5f-bad65231b596 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:38.145597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 287/584] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:38.150257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ae32-48a4-4f1b-9e5f-bad65231b596 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.199363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad10b3-3ab1-4e45-aa14-925213226d75 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:38.247283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedadb0-57f0-4ba5-829d-bbc40e24901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:38.248211 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedadb0-57f0-4ba5-829d-bbc40e24901f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:38.248658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedadb0-57f0-4ba5-829d-bbc40e24901f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:38.249096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedadb0-57f0-4ba5-829d-bbc40e24901f None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:38.250460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedadb0-57f0-4ba5-829d-bbc40e24901f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:38.250893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedadb0-57f0-4ba5-829d-bbc40e24901f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:38.252848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedadb0-57f0-4ba5-829d-bbc40e24901f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:38.273718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 298/585] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 17 14:59:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:38.278505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedadb0-57f0-4ba5-829d-bbc40e24901f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.282543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ae32-48a4-4f1b-9e5f-bad65231b596 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:38.294980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:38.350868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c3e67-2eb2-414e-a1c3-ef9545309171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:38.352170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c3e67-2eb2-414e-a1c3-ef9545309171 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:38.352597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c3e67-2eb2-414e-a1c3-ef9545309171 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:38.353014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c3e67-2eb2-414e-a1c3-ef9545309171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:38.365045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c3e67-2eb2-414e-a1c3-ef9545309171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:38.366599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c3e67-2eb2-414e-a1c3-ef9545309171 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-494c3e67-2eb2-414e-a1c3-ef9545309171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:38.386637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:38.393334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:38.394370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:38.394370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:38.394370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:38.394370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:38.394370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 288/586] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:38.394370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c3e67-2eb2-414e-a1c3-ef9545309171 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.429271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedadb0-57f0-4ba5-829d-bbc40e24901f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:38.444517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:38.484962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0441e1-4e18-4c9d-9d91-284daf1785fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:38.486439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0441e1-4e18-4c9d-9d91-284daf1785fb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:38.486919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0441e1-4e18-4c9d-9d91-284daf1785fb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:38.487361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0441e1-4e18-4c9d-9d91-284daf1785fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:38.503393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0441e1-4e18-4c9d-9d91-284daf1785fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:38.505810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0441e1-4e18-4c9d-9d91-284daf1785fb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-2a0441e1-4e18-4c9d-9d91-284daf1785fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:38.534095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:38.536044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:38.537855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:38.537855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:38.537855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:38.537855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:38.537855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 299/587] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:38.537855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0441e1-4e18-4c9d-9d91-284daf1785fb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.543895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c3e67-2eb2-414e-a1c3-ef9545309171 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:38.581175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6874c-a616-4f14-8302-12cf45fdab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:38.582002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6874c-a616-4f14-8302-12cf45fdab5f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:38.582285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6874c-a616-4f14-8302-12cf45fdab5f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:38.582564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6874c-a616-4f14-8302-12cf45fdab5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:38.590021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6874c-a616-4f14-8302-12cf45fdab5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:38.591515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6874c-a616-4f14-8302-12cf45fdab5f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-05c6874c-a616-4f14-8302-12cf45fdab5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:38.605943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:38.606845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:38.607732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:38.607732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:38.607732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:38.607732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:38.607732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:38.607732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:38.607732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:38.607732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:38.607732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 289/588] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:38.608857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6874c-a616-4f14-8302-12cf45fdab5f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.632391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:38.656660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0441e1-4e18-4c9d-9d91-284daf1785fb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:38.692388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273be829-0d20-494d-b125-b22bec4b4118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:38.693316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273be829-0d20-494d-b125-b22bec4b4118 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:38.693605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273be829-0d20-494d-b125-b22bec4b4118 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:38.694149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273be829-0d20-494d-b125-b22bec4b4118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:38.707058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273be829-0d20-494d-b125-b22bec4b4118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:38.708542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273be829-0d20-494d-b125-b22bec4b4118 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:38.720664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6874c-a616-4f14-8302-12cf45fdab5f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-273be829-0d20-494d-b125-b22bec4b4118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:38.727149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:38.728022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:38.729180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:38.729180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:38.729180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:38.729180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:38.729180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 300/589] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:38.729935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273be829-0d20-494d-b125-b22bec4b4118 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.750122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:38.760923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf36bd-7391-429b-af5d-312e6c1d0df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:38.761637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf36bd-7391-429b-af5d-312e6c1d0df9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:38.761923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf36bd-7391-429b-af5d-312e6c1d0df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:38.762264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf36bd-7391-429b-af5d-312e6c1d0df9 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:38.763003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf36bd-7391-429b-af5d-312e6c1d0df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:38.763586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf36bd-7391-429b-af5d-312e6c1d0df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:38.764708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf36bd-7391-429b-af5d-312e6c1d0df9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:38.781692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 290/590] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:38.781692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf36bd-7391-429b-af5d-312e6c1d0df9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.853363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273be829-0d20-494d-b125-b22bec4b4118 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:38.872401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:38.890726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d9baf-478b-4d55-b0c9-1cd315f4a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:38.891412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d9baf-478b-4d55-b0c9-1cd315f4a6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:38.891702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d9baf-478b-4d55-b0c9-1cd315f4a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:38.892011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d9baf-478b-4d55-b0c9-1cd315f4a6a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:38.892741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d9baf-478b-4d55-b0c9-1cd315f4a6a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:38.893046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d9baf-478b-4d55-b0c9-1cd315f4a6a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:38.893280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf36bd-7391-429b-af5d-312e6c1d0df9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:38.894453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d9baf-478b-4d55-b0c9-1cd315f4a6a7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:38.907780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 301/591] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:38.908642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d9baf-478b-4d55-b0c9-1cd315f4a6a7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.936374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627368de-fc0a-4ad1-ba5b-417ec36e1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:38.937048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627368de-fc0a-4ad1-ba5b-417ec36e1890 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:38.937373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627368de-fc0a-4ad1-ba5b-417ec36e1890 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:38.937653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627368de-fc0a-4ad1-ba5b-417ec36e1890 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:38.938445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627368de-fc0a-4ad1-ba5b-417ec36e1890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:38.938761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627368de-fc0a-4ad1-ba5b-417ec36e1890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:38.940210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627368de-fc0a-4ad1-ba5b-417ec36e1890 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:38.952815 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 291/592] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:38.953698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627368de-fc0a-4ad1-ba5b-417ec36e1890 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:38.993614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:39.027947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d9baf-478b-4d55-b0c9-1cd315f4a6a7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.063660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627368de-fc0a-4ad1-ba5b-417ec36e1890 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.064713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d924ae-644c-4353-adac-1665ba6d722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:39.065419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d924ae-644c-4353-adac-1665ba6d722a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.065705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d924ae-644c-4353-adac-1665ba6d722a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.065987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d924ae-644c-4353-adac-1665ba6d722a None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.066705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d924ae-644c-4353-adac-1665ba6d722a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:39.067018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d924ae-644c-4353-adac-1665ba6d722a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:39.068407 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d924ae-644c-4353-adac-1665ba6d722a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:39.083018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 302/593] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:39.088569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d924ae-644c-4353-adac-1665ba6d722a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:39.102415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cf4e3-4157-499a-b674-4f46f0aca1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:39.103385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cf4e3-4157-499a-b674-4f46f0aca1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.103802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cf4e3-4157-499a-b674-4f46f0aca1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.104323 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cf4e3-4157-499a-b674-4f46f0aca1b7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.112525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cf4e3-4157-499a-b674-4f46f0aca1b7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:39.114022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cf4e3-4157-499a-b674-4f46f0aca1b7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:39.117345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d75cf4e3-4157-499a-b674-4f46f0aca1b7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:39.131067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:39.132023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:39.132939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:39.132939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:39.132939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:39.132939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:39.132939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:39.132939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:39.132939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:39.132939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:39.132939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 14:59:39.132939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:39.137638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 292/594] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:39.138418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cf4e3-4157-499a-b674-4f46f0aca1b7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:39.197038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d924ae-644c-4353-adac-1665ba6d722a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.229136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:39.235579 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f7018-bb93-4871-a617-df8105daaa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:39.236391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f7018-bb93-4871-a617-df8105daaa86 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.236669 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f7018-bb93-4871-a617-df8105daaa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.236938 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f7018-bb93-4871-a617-df8105daaa86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.244313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f7018-bb93-4871-a617-df8105daaa86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:39.245810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f7018-bb93-4871-a617-df8105daaa86 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:39.251314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cf4e3-4157-499a-b674-4f46f0aca1b7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-745f7018-bb93-4871-a617-df8105daaa86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:39.260154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:39.261150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:39.262089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:39.262089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:39.262089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:39.262089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:39.262089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:39.262089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:39.262089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:39.262089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:39.262089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 303/595] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:39.263761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f7018-bb93-4871-a617-df8105daaa86 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:39.298196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54721a-11e6-4903-b9eb-6f97c7cb0ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:39.299134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54721a-11e6-4903-b9eb-6f97c7cb0ba9 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.299416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54721a-11e6-4903-b9eb-6f97c7cb0ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.299703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54721a-11e6-4903-b9eb-6f97c7cb0ba9 None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/d8b74d07fba34715a488539d630b0bd0/roles/eda8425696ad4dc7b29f5a2ab7961a35` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.317023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54721a-11e6-4903-b9eb-6f97c7cb0ba9 None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=d8b74d07fba34715a488539d630b0bd0, role_id=eda8425696ad4dc7b29f5a2ab7961a35)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:39.318751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54721a-11e6-4903-b9eb-6f97c7cb0ba9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:39.345237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 293/596] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:59:39 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/d8b74d07fba34715a488539d630b0bd0/roles/eda8425696ad4dc7b29f5a2ab7961a35 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:39.345237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54721a-11e6-4903-b9eb-6f97c7cb0ba9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:39.386757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f7018-bb93-4871-a617-df8105daaa86 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.395656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:39.438265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756c1e7-1f67-49ab-99fc-3670f0a15105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:39.439094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756c1e7-1f67-49ab-99fc-3670f0a15105 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.439368 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756c1e7-1f67-49ab-99fc-3670f0a15105 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.439827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756c1e7-1f67-49ab-99fc-3670f0a15105 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.448023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756c1e7-1f67-49ab-99fc-3670f0a15105 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:39.450309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756c1e7-1f67-49ab-99fc-3670f0a15105 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:39.456979 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54721a-11e6-4903-b9eb-6f97c7cb0ba9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4756c1e7-1f67-49ab-99fc-3670f0a15105 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:39.471680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:39.472662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:39.473572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:39.473572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:39.473572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:39.473572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:39.473572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:39.473572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:39.473572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:39.473572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:39.474117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 304/597] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:39.474876 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756c1e7-1f67-49ab-99fc-3670f0a15105 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:39.500441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531791b-bdb8-437d-8b16-e24bd82ce5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:39.501344 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531791b-bdb8-437d-8b16-e24bd82ce5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.501728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531791b-bdb8-437d-8b16-e24bd82ce5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.502016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531791b-bdb8-437d-8b16-e24bd82ce5b5 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.502875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531791b-bdb8-437d-8b16-e24bd82ce5b5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:39.503190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531791b-bdb8-437d-8b16-e24bd82ce5b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:39.504667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531791b-bdb8-437d-8b16-e24bd82ce5b5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:39.526577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 294/598] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Jun 17 14:59:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:39.527906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ce86-60b8-48aa-84e1-9c26a6050ac1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.528195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ce86-60b8-48aa-84e1-9c26a6050ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.528469 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ce86-60b8-48aa-84e1-9c26a6050ac1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.529905 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 295/599] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:39.530440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5ce86-60b8-48aa-84e1-9c26a6050ac1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:39.551966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:39.604789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756c1e7-1f67-49ab-99fc-3670f0a15105 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.644169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cecbf-cc38-4a13-947e-163c100b6743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:39.644567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5ce86-60b8-48aa-84e1-9c26a6050ac1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.645528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cecbf-cc38-4a13-947e-163c100b6743 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.646114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cecbf-cc38-4a13-947e-163c100b6743 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.646606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cecbf-cc38-4a13-947e-163c100b6743 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.647585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cecbf-cc38-4a13-947e-163c100b6743 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:39.648108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cecbf-cc38-4a13-947e-163c100b6743 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:39.649898 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cecbf-cc38-4a13-947e-163c100b6743 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:39.655395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:39.663946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 305/600] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:39.664761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cecbf-cc38-4a13-947e-163c100b6743 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:39.690564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58150348-5a08-4740-8eff-4637d7035473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:39.691224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150348-5a08-4740-8eff-4637d7035473 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.691509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150348-5a08-4740-8eff-4637d7035473 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.691788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150348-5a08-4740-8eff-4637d7035473 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.692587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58150348-5a08-4740-8eff-4637d7035473 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:39.692899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58150348-5a08-4740-8eff-4637d7035473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:39.694448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58150348-5a08-4740-8eff-4637d7035473 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:39.707641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 296/601] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:39.709235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9c436-6d2d-40ca-a3c0-95f966e147d2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.709744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9c436-6d2d-40ca-a3c0-95f966e147d2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.710227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9c436-6d2d-40ca-a3c0-95f966e147d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.732448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6fb9c436-6d2d-40ca-a3c0-95f966e147d2 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:39.733693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6fb9c436-6d2d-40ca-a3c0-95f966e147d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:39.779122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cecbf-cc38-4a13-947e-163c100b6743 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.794335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:39.821522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 297/602] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:39.821522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9c436-6d2d-40ca-a3c0-95f966e147d2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:39.828687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e77f3-c227-49f6-8e71-c3e78b5453a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:39.829690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e77f3-c227-49f6-8e71-c3e78b5453a7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.830002 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e77f3-c227-49f6-8e71-c3e78b5453a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.830239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e77f3-c227-49f6-8e71-c3e78b5453a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.845622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e77f3-c227-49f6-8e71-c3e78b5453a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:39.847084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e77f3-c227-49f6-8e71-c3e78b5453a7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5f0e77f3-c227-49f6-8e71-c3e78b5453a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:39.866316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:39.867832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:39.868768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:39.868768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:39.868768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:39.868768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:39.868768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 306/603] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:39.869116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e77f3-c227-49f6-8e71-c3e78b5453a7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:39.929660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:39.934280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9c436-6d2d-40ca-a3c0-95f966e147d2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.972114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d529066-f10b-4019-999a-9b784dc36081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:39.973015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d529066-f10b-4019-999a-9b784dc36081 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:39.973326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d529066-f10b-4019-999a-9b784dc36081 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:39.973608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d529066-f10b-4019-999a-9b784dc36081 None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/ca11a9d339bb4e799dc4e5531147ddda/roles/eda8425696ad4dc7b29f5a2ab7961a35` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:39.984999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e77f3-c227-49f6-8e71-c3e78b5453a7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:39.990416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d529066-f10b-4019-999a-9b784dc36081 None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=ca11a9d339bb4e799dc4e5531147ddda, role_id=eda8425696ad4dc7b29f5a2ab7961a35)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:39.991923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d529066-f10b-4019-999a-9b784dc36081 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:40.006536 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 298/604] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:59:39 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/ca11a9d339bb4e799dc4e5531147ddda/roles/eda8425696ad4dc7b29f5a2ab7961a35 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:40.007795 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d529066-f10b-4019-999a-9b784dc36081 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:40.046360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f4283-a906-41b2-887f-5a638a56184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:40.047942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f4283-a906-41b2-887f-5a638a56184e None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:40.048311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f4283-a906-41b2-887f-5a638a56184e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:40.048485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f4283-a906-41b2-887f-5a638a56184e None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/b9cc8b94e9ba470ca1f620b7cbed8e5b/roles/eda8425696ad4dc7b29f5a2ab7961a35` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:40.070914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f4283-a906-41b2-887f-5a638a56184e None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=b9cc8b94e9ba470ca1f620b7cbed8e5b, role_id=eda8425696ad4dc7b29f5a2ab7961a35)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:40.073847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f4283-a906-41b2-887f-5a638a56184e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:40.104417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 307/605] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:59:39 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/b9cc8b94e9ba470ca1f620b7cbed8e5b/roles/eda8425696ad4dc7b29f5a2ab7961a35 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:40.105989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f4283-a906-41b2-887f-5a638a56184e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:40.129948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:40.194267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d529066-f10b-4019-999a-9b784dc36081 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:40.264543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb8bfb-15d8-4f85-a2d2-a8ff4d090980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:40.265388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb8bfb-15d8-4f85-a2d2-a8ff4d090980 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:40.265667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb8bfb-15d8-4f85-a2d2-a8ff4d090980 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:40.265938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb8bfb-15d8-4f85-a2d2-a8ff4d090980 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:40.267916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f4283-a906-41b2-887f-5a638a56184e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:40.281136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb8bfb-15d8-4f85-a2d2-a8ff4d090980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-03cb8bfb-15d8-4f85-a2d2-a8ff4d090980 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:40.291750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:40.292977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:40.294056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:40.296013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 299/606] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:40.302782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb8bfb-15d8-4f85-a2d2-a8ff4d090980 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:40.318863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:40.325277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a60060-5080-41b0-8063-d1c22601607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:40.326577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a60060-5080-41b0-8063-d1c22601607e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:40.326910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a60060-5080-41b0-8063-d1c22601607e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:40.327217 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a60060-5080-41b0-8063-d1c22601607e None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:40.328159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a60060-5080-41b0-8063-d1c22601607e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:40.328474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a60060-5080-41b0-8063-d1c22601607e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:40.331210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a60060-5080-41b0-8063-d1c22601607e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:40.346332 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 308/607] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:40.352584 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a60060-5080-41b0-8063-d1c22601607e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:40.428903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb8bfb-15d8-4f85-a2d2-a8ff4d090980 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:40.461603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:40.468429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35af288-e436-4b24-a580-54c4b6f80d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:40.469222 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35af288-e436-4b24-a580-54c4b6f80d90 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:40.469575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35af288-e436-4b24-a580-54c4b6f80d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:40.469920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35af288-e436-4b24-a580-54c4b6f80d90 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:40.470730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35af288-e436-4b24-a580-54c4b6f80d90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:40.471101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35af288-e436-4b24-a580-54c4b6f80d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:40.472656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35af288-e436-4b24-a580-54c4b6f80d90 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:40.483129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 300/608] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:40.486971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a60060-5080-41b0-8063-d1c22601607e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:40.488846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35af288-e436-4b24-a580-54c4b6f80d90 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:40.596143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:40.597592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52779f5c-7d03-48cc-bce0-59790b6eb58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:40.598620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52779f5c-7d03-48cc-bce0-59790b6eb58f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:40.598976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52779f5c-7d03-48cc-bce0-59790b6eb58f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:40.599287 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52779f5c-7d03-48cc-bce0-59790b6eb58f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:40.618627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52779f5c-7d03-48cc-bce0-59790b6eb58f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:40.620457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52779f5c-7d03-48cc-bce0-59790b6eb58f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:40.632460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35af288-e436-4b24-a580-54c4b6f80d90 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-52779f5c-7d03-48cc-bce0-59790b6eb58f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:40.657280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:40.658322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:40.659224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:40.659224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:40.659224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:40.659224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:40.659224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:40.659224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:40.659224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:40.659224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:40.660100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 309/609] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:40.666554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52779f5c-7d03-48cc-bce0-59790b6eb58f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:40.678045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284e980-e2ef-4190-ba77-d191e8f36aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:40.678861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284e980-e2ef-4190-ba77-d191e8f36aca None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:40.679142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284e980-e2ef-4190-ba77-d191e8f36aca None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:40.679420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284e980-e2ef-4190-ba77-d191e8f36aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:40.694223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284e980-e2ef-4190-ba77-d191e8f36aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:40.695776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284e980-e2ef-4190-ba77-d191e8f36aca None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6284e980-e2ef-4190-ba77-d191e8f36aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:40.726520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:40.727484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:40.728445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:40.728445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:40.728445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:40.728445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:40.729271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 301/610] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:40.734573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284e980-e2ef-4190-ba77-d191e8f36aca None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:40.857107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52779f5c-7d03-48cc-bce0-59790b6eb58f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:40.934400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284e980-e2ef-4190-ba77-d191e8f36aca None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:40.942801 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caee2b4-9db0-4639-b09c-574945e8391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:40.943485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee2b4-9db0-4639-b09c-574945e8391a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:40.943769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee2b4-9db0-4639-b09c-574945e8391a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:40.944047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee2b4-9db0-4639-b09c-574945e8391a None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:40.944838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caee2b4-9db0-4639-b09c-574945e8391a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:40.945148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caee2b4-9db0-4639-b09c-574945e8391a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:40.946636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caee2b4-9db0-4639-b09c-574945e8391a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:40.948793 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:40.963822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:40.978241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 310/611] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:40.980796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caee2b4-9db0-4639-b09c-574945e8391a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:40.988793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc10f8-4b60-4a65-8a39-6e2a5dec93d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:40.990005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc10f8-4b60-4a65-8a39-6e2a5dec93d4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:40.992707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc10f8-4b60-4a65-8a39-6e2a5dec93d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:40.993200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc10f8-4b60-4a65-8a39-6e2a5dec93d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:40.994441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc10f8-4b60-4a65-8a39-6e2a5dec93d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:40.996329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc10f8-4b60-4a65-8a39-6e2a5dec93d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:40.998077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc10f8-4b60-4a65-8a39-6e2a5dec93d4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:41.022784 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 302/612] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:41.028443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc10f8-4b60-4a65-8a39-6e2a5dec93d4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:41.145613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc10f8-4b60-4a65-8a39-6e2a5dec93d4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:41.184570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866dac3-65ee-421f-addd-a9b2ba0c06ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:41.185836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866dac3-65ee-421f-addd-a9b2ba0c06ce None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:41.186347 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866dac3-65ee-421f-addd-a9b2ba0c06ce None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:41.186825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866dac3-65ee-421f-addd-a9b2ba0c06ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:41.195083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866dac3-65ee-421f-addd-a9b2ba0c06ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:41.197076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866dac3-65ee-421f-addd-a9b2ba0c06ce None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2866dac3-65ee-421f-addd-a9b2ba0c06ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:41.213725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:41.214718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:41.215662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:41.215662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:41.215662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:41.215662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:41.215662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:41.215662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:41.215662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:41.215662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:41.215662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 14:59:41.215662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:41.218614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 303/613] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:59:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:41.228186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caee2b4-9db0-4639-b09c-574945e8391a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:41.232296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866dac3-65ee-421f-addd-a9b2ba0c06ce None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:41.287370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:41.295001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba4470-0a9e-44d5-bac6-5e0535cb3f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:41.295925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba4470-0a9e-44d5-bac6-5e0535cb3f79 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:41.296204 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba4470-0a9e-44d5-bac6-5e0535cb3f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:41.296479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba4470-0a9e-44d5-bac6-5e0535cb3f79 None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/20745118f9eb436096a323ba2d22e94f/roles/eda8425696ad4dc7b29f5a2ab7961a35` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:41.334901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba4470-0a9e-44d5-bac6-5e0535cb3f79 None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=20745118f9eb436096a323ba2d22e94f, role_id=eda8425696ad4dc7b29f5a2ab7961a35)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:41.336354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba4470-0a9e-44d5-bac6-5e0535cb3f79 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:41.364478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866dac3-65ee-421f-addd-a9b2ba0c06ce None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:41.370357 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 311/614] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:59:40 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/20745118f9eb436096a323ba2d22e94f/roles/eda8425696ad4dc7b29f5a2ab7961a35 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 14:59:41.412263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6519a-af2a-4b36-9bb2-88160d985b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:41.413331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6519a-af2a-4b36-9bb2-88160d985b64 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:41.413839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6519a-af2a-4b36-9bb2-88160d985b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:41.414306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6519a-af2a-4b36-9bb2-88160d985b64 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:41.415407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6519a-af2a-4b36-9bb2-88160d985b64 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:41.416014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6519a-af2a-4b36-9bb2-88160d985b64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:41.417732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6519a-af2a-4b36-9bb2-88160d985b64 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:41.440228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 304/615] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 17 14:59:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:41.445559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba4470-0a9e-44d5-bac6-5e0535cb3f79 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:41.528381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:41.598398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba4470-0a9e-44d5-bac6-5e0535cb3f79 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:41.638876 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae122c14-4719-4057-87a2-16a59f816a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:41.639691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae122c14-4719-4057-87a2-16a59f816a89 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:41.639974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae122c14-4719-4057-87a2-16a59f816a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:41.640247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae122c14-4719-4057-87a2-16a59f816a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:41.653577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae122c14-4719-4057-87a2-16a59f816a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:41.655059 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae122c14-4719-4057-87a2-16a59f816a89 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ae122c14-4719-4057-87a2-16a59f816a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:41.675180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:41.676074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:41.676945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:41.676945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:41.676945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:41.676945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:41.676945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 312/616] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:41.682318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6519a-af2a-4b36-9bb2-88160d985b64 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:41.818514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:41.824040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6519a-af2a-4b36-9bb2-88160d985b64 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:41.867030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71514c-b48c-4cb6-8045-8712a9beea50 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:41.867359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71514c-b48c-4cb6-8045-8712a9beea50 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:41.867597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71514c-b48c-4cb6-8045-8712a9beea50 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:41.868037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8592-af7c-46c5-ba39-ad8da8659d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:41.869155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8592-af7c-46c5-ba39-ad8da8659d98 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:41.869466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 313/617] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:41.869708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8592-af7c-46c5-ba39-ad8da8659d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:41.869708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8592-af7c-46c5-ba39-ad8da8659d98 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:41.870468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8592-af7c-46c5-ba39-ad8da8659d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:41.870778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8592-af7c-46c5-ba39-ad8da8659d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:41.872191 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8592-af7c-46c5-ba39-ad8da8659d98 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:41.874700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d141e-8208-4d7d-80dc-fdf031cd0d51 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:41.875231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d141e-8208-4d7d-80dc-fdf031cd0d51 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:41.875728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d141e-8208-4d7d-80dc-fdf031cd0d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:41.885667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 305/618] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:41.892101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8592-af7c-46c5-ba39-ad8da8659d98 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:41.906339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-799d141e-8208-4d7d-80dc-fdf031cd0d51 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:41.907891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-799d141e-8208-4d7d-80dc-fdf031cd0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:42.038645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 314/619] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:42.060377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8592-af7c-46c5-ba39-ad8da8659d98 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:42.076476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d141e-8208-4d7d-80dc-fdf031cd0d51 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:42.110717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30260e4-b2f2-4aed-b50e-dced9c7b53a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:42.111936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30260e4-b2f2-4aed-b50e-dced9c7b53a7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:42.112620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30260e4-b2f2-4aed-b50e-dced9c7b53a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:42.113095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30260e4-b2f2-4aed-b50e-dced9c7b53a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:42.121328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30260e4-b2f2-4aed-b50e-dced9c7b53a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:42.123135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30260e4-b2f2-4aed-b50e-dced9c7b53a7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:42.138817 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b30260e4-b2f2-4aed-b50e-dced9c7b53a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:42.139914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:42.140785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:42.141711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:42.141711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:42.141711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:42.141711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:42.141711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:42.141711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:42.141711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:42.141711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:42.144562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 306/620] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:42.150078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30260e4-b2f2-4aed-b50e-dced9c7b53a7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:42.181328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:42.265461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d141e-8208-4d7d-80dc-fdf031cd0d51 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:42.302257 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0713de-a4c0-4cce-a3e8-95c14f36fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:42.302987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0713de-a4c0-4cce-a3e8-95c14f36fbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:42.303262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0713de-a4c0-4cce-a3e8-95c14f36fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:42.303530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0713de-a4c0-4cce-a3e8-95c14f36fbd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:42.316289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0713de-a4c0-4cce-a3e8-95c14f36fbd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ae0713de-a4c0-4cce-a3e8-95c14f36fbd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:42.324352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:42.325355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:42.326511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 315/621] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:42.331852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0713de-a4c0-4cce-a3e8-95c14f36fbd6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:42.375791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30260e4-b2f2-4aed-b50e-dced9c7b53a7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:42.442342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d069eb-9604-4ea5-94a6-3d306eacb9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:42.443014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d069eb-9604-4ea5-94a6-3d306eacb9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:42.443304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d069eb-9604-4ea5-94a6-3d306eacb9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:42.443577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d069eb-9604-4ea5-94a6-3d306eacb9e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:42.444381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d069eb-9604-4ea5-94a6-3d306eacb9e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:42.444690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d069eb-9604-4ea5-94a6-3d306eacb9e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:42.446169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d069eb-9604-4ea5-94a6-3d306eacb9e1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:42.472962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 307/622] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:42.481125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d069eb-9604-4ea5-94a6-3d306eacb9e1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:42.487089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:42.519566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0713de-a4c0-4cce-a3e8-95c14f36fbd6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:42.588971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243fe7-e07b-4305-aa80-85d80cf410dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:42.589613 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243fe7-e07b-4305-aa80-85d80cf410dc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:42.589896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243fe7-e07b-4305-aa80-85d80cf410dc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:42.590174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243fe7-e07b-4305-aa80-85d80cf410dc None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:42.590932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243fe7-e07b-4305-aa80-85d80cf410dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:42.591240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243fe7-e07b-4305-aa80-85d80cf410dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:42.592660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243fe7-e07b-4305-aa80-85d80cf410dc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:42.611710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 316/623] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:42.618065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243fe7-e07b-4305-aa80-85d80cf410dc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:42.641237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:42.664748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d069eb-9604-4ea5-94a6-3d306eacb9e1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:42.704370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff74192-39c7-4309-b902-433f6715da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:42.705376 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff74192-39c7-4309-b902-433f6715da51 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:42.705655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff74192-39c7-4309-b902-433f6715da51 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:42.706243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff74192-39c7-4309-b902-433f6715da51 None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/34feb70a340c4fc5b1fad510328c009b/roles/eda8425696ad4dc7b29f5a2ab7961a35` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:42.727473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff74192-39c7-4309-b902-433f6715da51 None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=34feb70a340c4fc5b1fad510328c009b, role_id=eda8425696ad4dc7b29f5a2ab7961a35)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:42.729444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff74192-39c7-4309-b902-433f6715da51 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:42.750433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 308/624] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:59:42 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/34feb70a340c4fc5b1fad510328c009b/roles/eda8425696ad4dc7b29f5a2ab7961a35 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 14:59:42.751782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906de3-2f71-4c21-937c-8b56403e47e9 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:42.752070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906de3-2f71-4c21-937c-8b56403e47e9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:42.752353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906de3-2f71-4c21-937c-8b56403e47e9 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:42.754115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 309/625] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:42.756282 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243fe7-e07b-4305-aa80-85d80cf410dc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:42.770080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6f729-fe42-43c7-9ae2-a3365f54ec5a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:42.770406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6f729-fe42-43c7-9ae2-a3365f54ec5a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:42.770648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6f729-fe42-43c7-9ae2-a3365f54ec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:42.816761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1fa6f729-fe42-43c7-9ae2-a3365f54ec5a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:42.821057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1fa6f729-fe42-43c7-9ae2-a3365f54ec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:42.844098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bc801-cfab-4350-bb27-626a23c11100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:42.845247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bc801-cfab-4350-bb27-626a23c11100 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:42.845247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bc801-cfab-4350-bb27-626a23c11100 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:42.845462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bc801-cfab-4350-bb27-626a23c11100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:42.866827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bc801-cfab-4350-bb27-626a23c11100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:42.868409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bc801-cfab-4350-bb27-626a23c11100 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:42.894688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-995bc801-cfab-4350-bb27-626a23c11100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:42.919339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:42.921297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:42.922350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:42.922350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:42.922350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:42.922350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:42.922350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 317/626] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:42.927696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c5b70-abd6-4f92-9572-b049faaa42de None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:42.927696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c5b70-abd6-4f92-9572-b049faaa42de None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:42.927696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c5b70-abd6-4f92-9572-b049faaa42de None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:42.929326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 318/627] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:42.930250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c5b70-abd6-4f92-9572-b049faaa42de None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:42.940212 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 310/628] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:42.941690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2d657-8077-4fcb-802f-4cfe4e1b0f9b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:42.941979 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2d657-8077-4fcb-802f-4cfe4e1b0f9b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:42.942257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2d657-8077-4fcb-802f-4cfe4e1b0f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:42.967350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9ca2d657-8077-4fcb-802f-4cfe4e1b0f9b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:42.968996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9ca2d657-8077-4fcb-802f-4cfe4e1b0f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:43.036676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:43.053989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 311/629] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:43.054857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2d657-8077-4fcb-802f-4cfe4e1b0f9b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:43.086873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c5b70-abd6-4f92-9572-b049faaa42de None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:43.132524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e00836-3955-4c4e-bede-d0cd864fadcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:43.133121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e00836-3955-4c4e-bede-d0cd864fadcf None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:43.133446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e00836-3955-4c4e-bede-d0cd864fadcf None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:43.133876 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e00836-3955-4c4e-bede-d0cd864fadcf None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:43.134690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e00836-3955-4c4e-bede-d0cd864fadcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:43.135241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e00836-3955-4c4e-bede-d0cd864fadcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:43.136960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e00836-3955-4c4e-bede-d0cd864fadcf None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:43.152715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 319/630] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:43.157679 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e00836-3955-4c4e-bede-d0cd864fadcf None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:43.182720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2d657-8077-4fcb-802f-4cfe4e1b0f9b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:43.220225 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a417c4-9fad-4ce4-bb40-374d50df02ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:43.221665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a417c4-9fad-4ce4-bb40-374d50df02ca None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:43.222308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a417c4-9fad-4ce4-bb40-374d50df02ca None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:43.222794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a417c4-9fad-4ce4-bb40-374d50df02ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:43.234351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:43.239962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a417c4-9fad-4ce4-bb40-374d50df02ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-64a417c4-9fad-4ce4-bb40-374d50df02ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:43.250156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:43.251429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:43.252436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:43.255304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 312/631] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:43.256280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a417c4-9fad-4ce4-bb40-374d50df02ca None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:43.289832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e00836-3955-4c4e-bede-d0cd864fadcf None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:43.319667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:43.338249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4edf29-69ad-41c9-b2f2-d38e2327a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:43.339261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4edf29-69ad-41c9-b2f2-d38e2327a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:43.339548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4edf29-69ad-41c9-b2f2-d38e2327a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:43.339829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4edf29-69ad-41c9-b2f2-d38e2327a6c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:43.354065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4edf29-69ad-41c9-b2f2-d38e2327a6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-af4edf29-69ad-41c9-b2f2-d38e2327a6c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:43.363940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:43.365121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:43.366179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 320/632] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:43.367031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4edf29-69ad-41c9-b2f2-d38e2327a6c5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:43.392422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a417c4-9fad-4ce4-bb40-374d50df02ca None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:43.438734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70894d-f1a4-4aaa-a913-8a12ae209d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:43.439548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70894d-f1a4-4aaa-a913-8a12ae209d5f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:43.439835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70894d-f1a4-4aaa-a913-8a12ae209d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:43.440108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70894d-f1a4-4aaa-a913-8a12ae209d5f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:43.448664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70894d-f1a4-4aaa-a913-8a12ae209d5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:43.450163 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70894d-f1a4-4aaa-a913-8a12ae209d5f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0e70894d-f1a4-4aaa-a913-8a12ae209d5f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:43.465964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:43.467802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:43.469814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:43.469814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:43.469814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:43.469814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:43.469814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:43.469814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:43.469814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:43.469814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:43.469814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 14:59:43.469814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:43.472016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 313/633] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:43.472904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70894d-f1a4-4aaa-a913-8a12ae209d5f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:43.551308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4edf29-69ad-41c9-b2f2-d38e2327a6c5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:43.591717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:43.598076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70894d-f1a4-4aaa-a913-8a12ae209d5f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:43.611585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:43.619290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff533a3-850a-49fe-9201-0563da7950bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:43.620083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff533a3-850a-49fe-9201-0563da7950bf None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:43.620629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff533a3-850a-49fe-9201-0563da7950bf None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:43.620981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff533a3-850a-49fe-9201-0563da7950bf None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:43.621969 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff533a3-850a-49fe-9201-0563da7950bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:43.622323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff533a3-850a-49fe-9201-0563da7950bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:43.623801 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff533a3-850a-49fe-9201-0563da7950bf None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:43.638623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 321/634] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:43.639879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff533a3-850a-49fe-9201-0563da7950bf None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:43.642740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72ec16-3845-4c82-be17-1ff3e7712b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:43.644843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72ec16-3845-4c82-be17-1ff3e7712b85 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:43.645344 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72ec16-3845-4c82-be17-1ff3e7712b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:43.645759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72ec16-3845-4c82-be17-1ff3e7712b85 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:43.646721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72ec16-3845-4c82-be17-1ff3e7712b85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:43.647247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72ec16-3845-4c82-be17-1ff3e7712b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:43.648833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72ec16-3845-4c82-be17-1ff3e7712b85 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:43.671386 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 314/635] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:43.671386 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72ec16-3845-4c82-be17-1ff3e7712b85 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:43.796807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff533a3-850a-49fe-9201-0563da7950bf None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:43.803880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72ec16-3845-4c82-be17-1ff3e7712b85 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:43.835192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44b89-e48d-4df5-948f-a42474ebc773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:43.835965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44b89-e48d-4df5-948f-a42474ebc773 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:43.836219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44b89-e48d-4df5-948f-a42474ebc773 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:43.836515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44b89-e48d-4df5-948f-a42474ebc773 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:43.837449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf44b89-e48d-4df5-948f-a42474ebc773 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:43.837726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf44b89-e48d-4df5-948f-a42474ebc773 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:43.839176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf44b89-e48d-4df5-948f-a42474ebc773 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:43.849163 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396e73c-c217-49a2-84ac-acd8dceba16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:43.849980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396e73c-c217-49a2-84ac-acd8dceba16a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:43.850269 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396e73c-c217-49a2-84ac-acd8dceba16a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:43.850542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396e73c-c217-49a2-84ac-acd8dceba16a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:43.860668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 322/636] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 17 14:59:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:43.861383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44b89-e48d-4df5-948f-a42474ebc773 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:43.867521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396e73c-c217-49a2-84ac-acd8dceba16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:43.870455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396e73c-c217-49a2-84ac-acd8dceba16a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b396e73c-c217-49a2-84ac-acd8dceba16a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:43.895588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:43.896656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:43.897703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:43.897703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:43.897703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:43.897703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:43.899286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 315/637] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:43.900907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08574c48-49de-47ac-aac6-1734e5db2b01 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:43.901188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08574c48-49de-47ac-aac6-1734e5db2b01 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:43.901491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08574c48-49de-47ac-aac6-1734e5db2b01 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:43.908519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 316/638] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:43.908519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08574c48-49de-47ac-aac6-1734e5db2b01 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:43.930376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:43.935142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:43.996566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44b89-e48d-4df5-948f-a42474ebc773 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:44.029010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08574c48-49de-47ac-aac6-1734e5db2b01 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:44.033856 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f1a56-7bf3-42da-9a60-75cdf0b4b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:44.034671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1a56-7bf3-42da-9a60-75cdf0b4b359 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:44.034953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1a56-7bf3-42da-9a60-75cdf0b4b359 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:44.035228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1a56-7bf3-42da-9a60-75cdf0b4b359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:44.047563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f1a56-7bf3-42da-9a60-75cdf0b4b359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:44.050592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f1a56-7bf3-42da-9a60-75cdf0b4b359 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4b2f1a56-7bf3-42da-9a60-75cdf0b4b359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:44.073302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:44.074352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:44.076169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:44.076169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:44.076169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:44.076169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:44.076169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 323/639] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:44.076169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f1a56-7bf3-42da-9a60-75cdf0b4b359 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:44.081568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1216e2-7eaf-4c44-a6d0-ceb334c0c2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:44.082327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1216e2-7eaf-4c44-a6d0-ceb334c0c2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:44.082569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1216e2-7eaf-4c44-a6d0-ceb334c0c2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:44.082926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1216e2-7eaf-4c44-a6d0-ceb334c0c2c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:44.165951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1216e2-7eaf-4c44-a6d0-ceb334c0c2c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:44.167861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1216e2-7eaf-4c44-a6d0-ceb334c0c2c4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:44.182038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:44.196405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:44.198086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f1a56-7bf3-42da-9a60-75cdf0b4b359 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:44.240616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46570b76-c260-4058-8678-37873a499b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:44.241315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46570b76-c260-4058-8678-37873a499b10 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:44.241594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46570b76-c260-4058-8678-37873a499b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:44.241862 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46570b76-c260-4058-8678-37873a499b10 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:44.242588 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46570b76-c260-4058-8678-37873a499b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:44.243000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46570b76-c260-4058-8678-37873a499b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:44.244681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46570b76-c260-4058-8678-37873a499b10 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:44.264737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 324/640] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:44.270225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d442-8abb-403e-bafb-1c45d79a7d01 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:44.270471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d442-8abb-403e-bafb-1c45d79a7d01 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:44.270750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d442-8abb-403e-bafb-1c45d79a7d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:44.287953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1bf7d442-8abb-403e-bafb-1c45d79a7d01 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:44.289672 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1bf7d442-8abb-403e-bafb-1c45d79a7d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:44.303491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 317/641] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:44.303491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1216e2-7eaf-4c44-a6d0-ceb334c0c2c4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:44.373703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 325/642] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:44.381942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d442-8abb-403e-bafb-1c45d79a7d01 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:44.436011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1216e2-7eaf-4c44-a6d0-ceb334c0c2c4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:44.473719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:44.485133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a15815-ecbe-4e15-8b89-50b264314b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:44.486217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a15815-ecbe-4e15-8b89-50b264314b24 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:44.486729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a15815-ecbe-4e15-8b89-50b264314b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:44.487016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a15815-ecbe-4e15-8b89-50b264314b24 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:44.488059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a15815-ecbe-4e15-8b89-50b264314b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:44.488428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a15815-ecbe-4e15-8b89-50b264314b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:44.489922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a15815-ecbe-4e15-8b89-50b264314b24 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:44.502128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:44.505763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 318/643] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:44.511220 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a15815-ecbe-4e15-8b89-50b264314b24 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:44.523648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d442-8abb-403e-bafb-1c45d79a7d01 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:44.567874 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b1211-c0bc-4ecc-8487-1b77eb284b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:44.568685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b1211-c0bc-4ecc-8487-1b77eb284b24 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:44.568962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b1211-c0bc-4ecc-8487-1b77eb284b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:44.569394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b1211-c0bc-4ecc-8487-1b77eb284b24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:44.577911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b1211-c0bc-4ecc-8487-1b77eb284b24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:44.579493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b1211-c0bc-4ecc-8487-1b77eb284b24 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-091b1211-c0bc-4ecc-8487-1b77eb284b24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:44.595326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:44.596461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:44.597481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 326/644] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 17 14:59:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:44.598117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b1211-c0bc-4ecc-8487-1b77eb284b24 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:44.631239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a15815-ecbe-4e15-8b89-50b264314b24 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:44.674992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc728fbf-6d08-4964-97e4-bab9d4ed2476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:44.675812 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc728fbf-6d08-4964-97e4-bab9d4ed2476 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:44.676093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc728fbf-6d08-4964-97e4-bab9d4ed2476 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:44.676372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc728fbf-6d08-4964-97e4-bab9d4ed2476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:44.689060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc728fbf-6d08-4964-97e4-bab9d4ed2476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:44.690519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc728fbf-6d08-4964-97e4-bab9d4ed2476 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bc728fbf-6d08-4964-97e4-bab9d4ed2476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:44.711230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:44.713921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:44.714987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:44.714987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:44.714987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:44.714987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:44.714987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 319/645] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:44.714987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc728fbf-6d08-4964-97e4-bab9d4ed2476 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:44.722974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b1211-c0bc-4ecc-8487-1b77eb284b24 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:44.756390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:44.761808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9a18-395d-44ec-8986-733795429190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:44.762633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9a18-395d-44ec-8986-733795429190 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:44.762902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9a18-395d-44ec-8986-733795429190 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:44.763164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9a18-395d-44ec-8986-733795429190 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:44.774566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea9a18-395d-44ec-8986-733795429190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-10ea9a18-395d-44ec-8986-733795429190 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:44.782939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:44.784008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:44.784839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:44.791744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 327/646] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:44.791744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9a18-395d-44ec-8986-733795429190 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:44.795766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:44.845025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc728fbf-6d08-4964-97e4-bab9d4ed2476 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:44.893067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed5af1-7fb6-459f-a8f0-7b97e3137a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:44.894345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed5af1-7fb6-459f-a8f0-7b97e3137a3a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:44.894345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed5af1-7fb6-459f-a8f0-7b97e3137a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:44.894545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed5af1-7fb6-459f-a8f0-7b97e3137a3a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:44.902939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed5af1-7fb6-459f-a8f0-7b97e3137a3a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:44.904400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed5af1-7fb6-459f-a8f0-7b97e3137a3a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-60ed5af1-7fb6-459f-a8f0-7b97e3137a3a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:44.920321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:44.921365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:44.922918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:44.922918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:44.922918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:44.922918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:44.922918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:44.922918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:44.922918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:44.922918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:44.922918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 14:59:44.922918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:44.923457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9a18-395d-44ec-8986-733795429190 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:44.923541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 320/647] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:44.923541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed5af1-7fb6-459f-a8f0-7b97e3137a3a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:44.964884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b89ca-cc99-4e3c-bfaa-0c15d1d1ad30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:44.965528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b89ca-cc99-4e3c-bfaa-0c15d1d1ad30 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:44.965927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b89ca-cc99-4e3c-bfaa-0c15d1d1ad30 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:44.966203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b89ca-cc99-4e3c-bfaa-0c15d1d1ad30 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:44.967045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b89ca-cc99-4e3c-bfaa-0c15d1d1ad30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:44.967355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b89ca-cc99-4e3c-bfaa-0c15d1d1ad30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:44.968794 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b89ca-cc99-4e3c-bfaa-0c15d1d1ad30 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:45.000036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 328/648] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 17 14:59:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:45.000036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b89ca-cc99-4e3c-bfaa-0c15d1d1ad30 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:45.071050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:45.073789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:45.078098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed5af1-7fb6-459f-a8f0-7b97e3137a3a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:45.114934 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f5e94-bbae-4e2b-b45d-b9b9f643f7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:45.115615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f5e94-bbae-4e2b-b45d-b9b9f643f7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:45.115898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f5e94-bbae-4e2b-b45d-b9b9f643f7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:45.116305 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f5e94-bbae-4e2b-b45d-b9b9f643f7d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:45.117024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b89ca-cc99-4e3c-bfaa-0c15d1d1ad30 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:45.117134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f5e94-bbae-4e2b-b45d-b9b9f643f7d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:45.117444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f5e94-bbae-4e2b-b45d-b9b9f643f7d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:45.119226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f5e94-bbae-4e2b-b45d-b9b9f643f7d5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:45.131681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 321/649] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:45.132427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f5e94-bbae-4e2b-b45d-b9b9f643f7d5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:45.155673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e896ad-287d-44c7-bd57-10ec2f8eca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:45.156371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e896ad-287d-44c7-bd57-10ec2f8eca18 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:45.156644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e896ad-287d-44c7-bd57-10ec2f8eca18 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:45.156917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e896ad-287d-44c7-bd57-10ec2f8eca18 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:45.157700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e896ad-287d-44c7-bd57-10ec2f8eca18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:45.158004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e896ad-287d-44c7-bd57-10ec2f8eca18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:45.159379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e896ad-287d-44c7-bd57-10ec2f8eca18 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:45.168293 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 329/650] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:45.169123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e896ad-287d-44c7-bd57-10ec2f8eca18 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:45.248423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f5e94-bbae-4e2b-b45d-b9b9f643f7d5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:45.280469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e896ad-287d-44c7-bd57-10ec2f8eca18 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:45.290860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef4348-950e-4157-8fd6-8cba78b35a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:45.291963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4348-950e-4157-8fd6-8cba78b35a8e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:45.292243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4348-950e-4157-8fd6-8cba78b35a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:45.292519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4348-950e-4157-8fd6-8cba78b35a8e None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:45.293404 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef4348-950e-4157-8fd6-8cba78b35a8e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:45.293731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef4348-950e-4157-8fd6-8cba78b35a8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:45.295226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef4348-950e-4157-8fd6-8cba78b35a8e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:45.304950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:45.315702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 322/651] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 17 14:59:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:45.317097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76680bd-a4c1-455a-87e7-c3f27388e407 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:45.317368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76680bd-a4c1-455a-87e7-c3f27388e407 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:45.317941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76680bd-a4c1-455a-87e7-c3f27388e407 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:45.318886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 323/652] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:45.319590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76680bd-a4c1-455a-87e7-c3f27388e407 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:45.323459 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940eda8-5434-4d59-b8c6-516a4deb19a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:45.324366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940eda8-5434-4d59-b8c6-516a4deb19a6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:45.324638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940eda8-5434-4d59-b8c6-516a4deb19a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:45.324915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940eda8-5434-4d59-b8c6-516a4deb19a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:45.337623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:45.411228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940eda8-5434-4d59-b8c6-516a4deb19a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:45.413162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940eda8-5434-4d59-b8c6-516a4deb19a6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:45.435552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76680bd-a4c1-455a-87e7-c3f27388e407 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:45.473495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63efd4f-3505-4368-86e2-20ae37ca5002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:45.474300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63efd4f-3505-4368-86e2-20ae37ca5002 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:45.474582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63efd4f-3505-4368-86e2-20ae37ca5002 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:45.474950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63efd4f-3505-4368-86e2-20ae37ca5002 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:45.482416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63efd4f-3505-4368-86e2-20ae37ca5002 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:45.483886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63efd4f-3505-4368-86e2-20ae37ca5002 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a63efd4f-3505-4368-86e2-20ae37ca5002 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:45.498041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:45.499149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:45.500033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:45.500033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:45.500033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:45.500033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:45.500033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:45.500033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:45.500033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:45.500033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:45.500033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 324/653] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:45.500033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63efd4f-3505-4368-86e2-20ae37ca5002 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:45.524576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 330/654] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:45.525742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940eda8-5434-4d59-b8c6-516a4deb19a6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:45.558171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:45.591090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:45.617721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63efd4f-3505-4368-86e2-20ae37ca5002 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:45.656572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940eda8-5434-4d59-b8c6-516a4deb19a6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:45.656799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35377df0-af30-4be3-af99-e56f323a2e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:45.657430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35377df0-af30-4be3-af99-e56f323a2e18 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:45.657715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35377df0-af30-4be3-af99-e56f323a2e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:45.658005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35377df0-af30-4be3-af99-e56f323a2e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:45.670879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35377df0-af30-4be3-af99-e56f323a2e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:45.673786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35377df0-af30-4be3-af99-e56f323a2e18 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:45.693250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bba5d-ae72-4017-9aac-e06cf1440c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:45.693908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bba5d-ae72-4017-9aac-e06cf1440c2c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:45.694193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bba5d-ae72-4017-9aac-e06cf1440c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:45.694467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bba5d-ae72-4017-9aac-e06cf1440c2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-35377df0-af30-4be3-af99-e56f323a2e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:45.694586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:45.695488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:45.696361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:45.696361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:45.696361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:45.696361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:45.696361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 325/655] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:45.697395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8580a6-0191-4178-95f0-5d4bd823960d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:45.697852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8580a6-0191-4178-95f0-5d4bd823960d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:45.698126 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8580a6-0191-4178-95f0-5d4bd823960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:45.716210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6e8580a6-0191-4178-95f0-5d4bd823960d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:45.717434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6e8580a6-0191-4178-95f0-5d4bd823960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:45.774385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bba5d-ae72-4017-9aac-e06cf1440c2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:45.776288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bba5d-ae72-4017-9aac-e06cf1440c2c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:45.794536 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 326/656] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:45.795412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8580a6-0191-4178-95f0-5d4bd823960d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:45.812710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:45.857523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:45.903242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 331/657] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:45.904718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bba5d-ae72-4017-9aac-e06cf1440c2c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:45.911359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8580a6-0191-4178-95f0-5d4bd823960d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:45.955620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e328a1-88bb-4763-b92e-aa694b362dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:45.956290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e328a1-88bb-4763-b92e-aa694b362dff None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:45.956568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e328a1-88bb-4763-b92e-aa694b362dff None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:45.956839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e328a1-88bb-4763-b92e-aa694b362dff None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:45.957676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e328a1-88bb-4763-b92e-aa694b362dff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:45.957981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e328a1-88bb-4763-b92e-aa694b362dff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:45.959460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e328a1-88bb-4763-b92e-aa694b362dff None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:45.977583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 327/658] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:45.978794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e328a1-88bb-4763-b92e-aa694b362dff None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.037702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bba5d-ae72-4017-9aac-e06cf1440c2c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:46.062671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:46.078275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4bb4e-fc6b-40fa-a6d8-0853f3461e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:46.082419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4bb4e-fc6b-40fa-a6d8-0853f3461e6b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:46.082419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4bb4e-fc6b-40fa-a6d8-0853f3461e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:46.082419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4bb4e-fc6b-40fa-a6d8-0853f3461e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:46.090017 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e328a1-88bb-4763-b92e-aa694b362dff None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:46.098762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4bb4e-fc6b-40fa-a6d8-0853f3461e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:46.098762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4bb4e-fc6b-40fa-a6d8-0853f3461e6b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:46.108201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-41a4bb4e-fc6b-40fa-a6d8-0853f3461e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:46.118796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:46.119950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:46.121079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:46.121079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:46.121079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:46.121079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:46.121079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 332/659] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:46.121079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4bb4e-fc6b-40fa-a6d8-0853f3461e6b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.139538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc7341-4c86-4f66-aaa9-80009ede38ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:46.140221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc7341-4c86-4f66-aaa9-80009ede38ff None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:46.140528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc7341-4c86-4f66-aaa9-80009ede38ff None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:46.140779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc7341-4c86-4f66-aaa9-80009ede38ff None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:46.141550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc7341-4c86-4f66-aaa9-80009ede38ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:46.141865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc7341-4c86-4f66-aaa9-80009ede38ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:46.143297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc7341-4c86-4f66-aaa9-80009ede38ff None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:46.157100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 328/660] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:46.158116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc7341-4c86-4f66-aaa9-80009ede38ff None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.235985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4bb4e-fc6b-40fa-a6d8-0853f3461e6b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:46.271395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc7341-4c86-4f66-aaa9-80009ede38ff None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:46.273261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad7a35-2a1a-447c-9593-ab99a0478d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:46.274060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad7a35-2a1a-447c-9593-ab99a0478d9d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:46.274336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad7a35-2a1a-447c-9593-ab99a0478d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:46.274608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad7a35-2a1a-447c-9593-ab99a0478d9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:46.286013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad7a35-2a1a-447c-9593-ab99a0478d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7dad7a35-2a1a-447c-9593-ab99a0478d9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:46.294053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:46.295091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 333/661] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:46.295939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad7a35-2a1a-447c-9593-ab99a0478d9d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.314414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941ad9-c9c7-4d6f-af07-43b8b30fc5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:46.315488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941ad9-c9c7-4d6f-af07-43b8b30fc5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:46.315899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941ad9-c9c7-4d6f-af07-43b8b30fc5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:46.316313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941ad9-c9c7-4d6f-af07-43b8b30fc5c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:46.331164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941ad9-c9c7-4d6f-af07-43b8b30fc5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:46.332624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941ad9-c9c7-4d6f-af07-43b8b30fc5c5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:46.336457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8f941ad9-c9c7-4d6f-af07-43b8b30fc5c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:46.353053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:46.354224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:46.355140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:46.355140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:46.355140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:46.355140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:46.355140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 329/662] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:46.355140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941ad9-c9c7-4d6f-af07-43b8b30fc5c5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.391082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:46.411814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad7a35-2a1a-447c-9593-ab99a0478d9d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:46.453930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b22be-66e3-4dd3-99cc-70b238c71b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:46.454638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b22be-66e3-4dd3-99cc-70b238c71b5c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:46.454923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b22be-66e3-4dd3-99cc-70b238c71b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:46.455204 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b22be-66e3-4dd3-99cc-70b238c71b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:46.456045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b22be-66e3-4dd3-99cc-70b238c71b5c None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=d8b74d07fba34715a488539d630b0bd0) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:46.456355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b22be-66e3-4dd3-99cc-70b238c71b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:46.457861 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b22be-66e3-4dd3-99cc-70b238c71b5c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:46.464800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 334/663] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:46 2022] GET /identity/v3/role_assignments?user.id=d8b74d07fba34715a488539d630b0bd0&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:46.465686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b22be-66e3-4dd3-99cc-70b238c71b5c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.472515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941ad9-c9c7-4d6f-af07-43b8b30fc5c5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:46.521322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c780fa-75f6-4e0d-94d9-4b68f8fc3254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:46.522023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c780fa-75f6-4e0d-94d9-4b68f8fc3254 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:46.522307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c780fa-75f6-4e0d-94d9-4b68f8fc3254 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:46.522586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c780fa-75f6-4e0d-94d9-4b68f8fc3254 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:46.523340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c780fa-75f6-4e0d-94d9-4b68f8fc3254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:46.523652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c780fa-75f6-4e0d-94d9-4b68f8fc3254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:46.525634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c780fa-75f6-4e0d-94d9-4b68f8fc3254 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:46.542490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 330/664] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:46.542490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c780fa-75f6-4e0d-94d9-4b68f8fc3254 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.626384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:46.630402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b22be-66e3-4dd3-99cc-70b238c71b5c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:46.658194 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:46.681256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c780fa-75f6-4e0d-94d9-4b68f8fc3254 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:46.681466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16ac5a-0869-4401-b925-98b035045f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:46.681466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ac5a-0869-4401-b925-98b035045f5d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:46.681466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ac5a-0869-4401-b925-98b035045f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:46.681466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ac5a-0869-4401-b925-98b035045f5d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:46.693149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16ac5a-0869-4401-b925-98b035045f5d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:46.694695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16ac5a-0869-4401-b925-98b035045f5d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-3e16ac5a-0869-4401-b925-98b035045f5d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:46.711198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:46.712638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 335/665] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:46.713911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16ac5a-0869-4401-b925-98b035045f5d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.736396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4628e7-ddbe-4a93-9c9b-411c4fbccebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:46.737081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4628e7-ddbe-4a93-9c9b-411c4fbccebc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:46.737401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4628e7-ddbe-4a93-9c9b-411c4fbccebc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:46.737673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4628e7-ddbe-4a93-9c9b-411c4fbccebc None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:46.738425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4628e7-ddbe-4a93-9c9b-411c4fbccebc None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:46.738733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4628e7-ddbe-4a93-9c9b-411c4fbccebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:46.740129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4628e7-ddbe-4a93-9c9b-411c4fbccebc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:46.749575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 331/666] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:46.754044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4628e7-ddbe-4a93-9c9b-411c4fbccebc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.866122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16ac5a-0869-4401-b925-98b035045f5d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:46.869990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4628e7-ddbe-4a93-9c9b-411c4fbccebc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:46.908923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac247-64e0-4f16-bf81-2528c820f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:46.909835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac247-64e0-4f16-bf81-2528c820f432 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:46.910119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac247-64e0-4f16-bf81-2528c820f432 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:46.910393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac247-64e0-4f16-bf81-2528c820f432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:46.911288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d972432-637f-4778-8140-49536d43511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:46.911964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972432-637f-4778-8140-49536d43511a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:46.912318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972432-637f-4778-8140-49536d43511a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:46.912599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972432-637f-4778-8140-49536d43511a None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:46.913732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d972432-637f-4778-8140-49536d43511a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:46.914131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d972432-637f-4778-8140-49536d43511a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:46.915577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d972432-637f-4778-8140-49536d43511a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:46.921189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac247-64e0-4f16-bf81-2528c820f432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:46.923733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac247-64e0-4f16-bf81-2528c820f432 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:46.933565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 336/667] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:46.934657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d972432-637f-4778-8140-49536d43511a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-dfcac247-64e0-4f16-bf81-2528c820f432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:46.941753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:46.942687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:46.943584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:46.943584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:46.943584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:46.943584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:46.943584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:46.943584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:46.943584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:46.943584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:46.944877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 332/668] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:46.945862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac247-64e0-4f16-bf81-2528c820f432 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:46.959922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:46.967503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:47.070992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac247-64e0-4f16-bf81-2528c820f432 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:47.081037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d972432-637f-4778-8140-49536d43511a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:47.115455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3352ed-f58f-4232-9ae6-f0870e34de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:47.116698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3352ed-f58f-4232-9ae6-f0870e34de0c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:47.117112 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3352ed-f58f-4232-9ae6-f0870e34de0c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:47.117578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3352ed-f58f-4232-9ae6-f0870e34de0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:47.134565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3352ed-f58f-4232-9ae6-f0870e34de0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:47.136220 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3352ed-f58f-4232-9ae6-f0870e34de0c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:47.137006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048cadc-315f-44bf-b4be-f7276bd6381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:47.137716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048cadc-315f-44bf-b4be-f7276bd6381e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:47.137993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048cadc-315f-44bf-b4be-f7276bd6381e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:47.138275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048cadc-315f-44bf-b4be-f7276bd6381e None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:47.139105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048cadc-315f-44bf-b4be-f7276bd6381e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:47.139461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048cadc-315f-44bf-b4be-f7276bd6381e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:47.141000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048cadc-315f-44bf-b4be-f7276bd6381e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4e3352ed-f58f-4232-9ae6-f0870e34de0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:47.169096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:47.177722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:47.179254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:47.179254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:47.179254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:47.179254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:47.179254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 333/669] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:47.179254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3352ed-f58f-4232-9ae6-f0870e34de0c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:47.179992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 337/670] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Jun 17 14:59:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:47.179992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048cadc-315f-44bf-b4be-f7276bd6381e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:47.252856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:47.285250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:47.303453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3352ed-f58f-4232-9ae6-f0870e34de0c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:47.313932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048cadc-315f-44bf-b4be-f7276bd6381e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:47.351382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3eba-117e-4e32-982e-ab4b04d45aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:47.352184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3eba-117e-4e32-982e-ab4b04d45aac None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:47.352485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3eba-117e-4e32-982e-ab4b04d45aac None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:47.352786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3eba-117e-4e32-982e-ab4b04d45aac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:47.355377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d89557-eacd-4d74-ae4b-8d935996bf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:47.356164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d89557-eacd-4d74-ae4b-8d935996bf66 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:47.356444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d89557-eacd-4d74-ae4b-8d935996bf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:47.356718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d89557-eacd-4d74-ae4b-8d935996bf66 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:47.357538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d89557-eacd-4d74-ae4b-8d935996bf66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:47.357853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d89557-eacd-4d74-ae4b-8d935996bf66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:47.359336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d89557-eacd-4d74-ae4b-8d935996bf66 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:47.360624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3eba-117e-4e32-982e-ab4b04d45aac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:47.362106 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3eba-117e-4e32-982e-ab4b04d45aac None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:47.379034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 338/671] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4bbb3eba-117e-4e32-982e-ab4b04d45aac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:47.379717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:47.380841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:47.381771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:47.381771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:47.381771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:47.381771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:47.381771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:47.381771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:47.381771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:47.381771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:47.381771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 334/672] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:47.382253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3eba-117e-4e32-982e-ab4b04d45aac None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:47.383453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d89557-eacd-4d74-ae4b-8d935996bf66 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:47.505278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d89557-eacd-4d74-ae4b-8d935996bf66 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:47.506848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3eba-117e-4e32-982e-ab4b04d45aac None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:47.532198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:47.544665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57f298-1861-452a-8cb1-05f8c456fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:47.545190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3475da-a5be-4aa5-9fca-5e4786c095cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:47.545348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57f298-1861-452a-8cb1-05f8c456fbde None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:47.545625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57f298-1861-452a-8cb1-05f8c456fbde None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:47.545884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3475da-a5be-4aa5-9fca-5e4786c095cc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:47.545995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57f298-1861-452a-8cb1-05f8c456fbde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:47.546169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3475da-a5be-4aa5-9fca-5e4786c095cc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:47.546458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3475da-a5be-4aa5-9fca-5e4786c095cc None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:47.547198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3475da-a5be-4aa5-9fca-5e4786c095cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:47.547510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3475da-a5be-4aa5-9fca-5e4786c095cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:47.548897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3475da-a5be-4aa5-9fca-5e4786c095cc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:47.550413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:47.567853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 335/673] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:47.568850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3475da-a5be-4aa5-9fca-5e4786c095cc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:47.649929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57f298-1861-452a-8cb1-05f8c456fbde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:47.652412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57f298-1861-452a-8cb1-05f8c456fbde None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:47.691027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3475da-a5be-4aa5-9fca-5e4786c095cc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:47.733256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b954ea-44a3-4a0c-9dcc-d9c8733d9c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:47.733960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b954ea-44a3-4a0c-9dcc-d9c8733d9c15 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:47.734238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b954ea-44a3-4a0c-9dcc-d9c8733d9c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:47.734517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b954ea-44a3-4a0c-9dcc-d9c8733d9c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:47.735339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b954ea-44a3-4a0c-9dcc-d9c8733d9c15 None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=ca11a9d339bb4e799dc4e5531147ddda) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:47.735647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b954ea-44a3-4a0c-9dcc-d9c8733d9c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:47.737077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b954ea-44a3-4a0c-9dcc-d9c8733d9c15 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:47.744927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 336/674] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:47 2022] GET /identity/v3/role_assignments?user.id=ca11a9d339bb4e799dc4e5531147ddda&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:47.745345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b954ea-44a3-4a0c-9dcc-d9c8733d9c15 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:47.795345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 339/675] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:47.796612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57f298-1861-452a-8cb1-05f8c456fbde None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:47.836275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:47.851650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:47.924059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b954ea-44a3-4a0c-9dcc-d9c8733d9c15 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:47.934437 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57f298-1861-452a-8cb1-05f8c456fbde None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:47.972248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599b763-b953-4743-9eb3-ab409d6305f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:47.973152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599b763-b953-4743-9eb3-ab409d6305f4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:47.973466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599b763-b953-4743-9eb3-ab409d6305f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:47.973746 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599b763-b953-4743-9eb3-ab409d6305f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:47.974545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599b763-b953-4743-9eb3-ab409d6305f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:47.974854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599b763-b953-4743-9eb3-ab409d6305f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:47.976307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599b763-b953-4743-9eb3-ab409d6305f4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:47.988516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea4e02-a10b-4350-968f-84a5801102ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:47.989769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea4e02-a10b-4350-968f-84a5801102ba None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:47.990229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea4e02-a10b-4350-968f-84a5801102ba None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:47.990693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea4e02-a10b-4350-968f-84a5801102ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:47.990813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 337/676] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:47.992272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599b763-b953-4743-9eb3-ab409d6305f4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:48.004904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea4e02-a10b-4350-968f-84a5801102ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:48.006631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea4e02-a10b-4350-968f-84a5801102ba None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-90ea4e02-a10b-4350-968f-84a5801102ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:48.024445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:48.026521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 340/677] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:59:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:48.028225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea4e02-a10b-4350-968f-84a5801102ba None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:48.135166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599b763-b953-4743-9eb3-ab409d6305f4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:48.149928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:48.165422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:48.174549 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea4e02-a10b-4350-968f-84a5801102ba None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:48.189122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13841daa-17c6-44ca-8b73-547ffb519d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:48.189966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841daa-17c6-44ca-8b73-547ffb519d99 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:48.190258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841daa-17c6-44ca-8b73-547ffb519d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:48.190541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841daa-17c6-44ca-8b73-547ffb519d99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:48.203562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13841daa-17c6-44ca-8b73-547ffb519d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:48.205167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13841daa-17c6-44ca-8b73-547ffb519d99 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:48.221894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace222-ffcd-461f-8c19-b6d950edd1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:48.222839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace222-ffcd-461f-8c19-b6d950edd1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:48.223265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace222-ffcd-461f-8c19-b6d950edd1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:48.223681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace222-ffcd-461f-8c19-b6d950edd1f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:48.224647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace222-ffcd-461f-8c19-b6d950edd1f2 None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=b9cc8b94e9ba470ca1f620b7cbed8e5b) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:48.225119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace222-ffcd-461f-8c19-b6d950edd1f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-13841daa-17c6-44ca-8b73-547ffb519d99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:48.227040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:48.228098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:48.229420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:48.229420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:48.229420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:48.229420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:48.229639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace222-ffcd-461f-8c19-b6d950edd1f2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:48.233429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 338/678] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:48.234390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13841daa-17c6-44ca-8b73-547ffb519d99 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:48.237151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 341/679] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:48 2022] GET /identity/v3/role_assignments?user.id=b9cc8b94e9ba470ca1f620b7cbed8e5b&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:48.245640 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace222-ffcd-461f-8c19-b6d950edd1f2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:48.378244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13841daa-17c6-44ca-8b73-547ffb519d99 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:48.418845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0682-b5dc-4d8d-b806-677ddbcccbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:48.419446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0682-b5dc-4d8d-b806-677ddbcccbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:48.419732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0682-b5dc-4d8d-b806-677ddbcccbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:48.420010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0682-b5dc-4d8d-b806-677ddbcccbf9 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:48.420856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0682-b5dc-4d8d-b806-677ddbcccbf9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:48.421171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0682-b5dc-4d8d-b806-677ddbcccbf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:48.428187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0682-b5dc-4d8d-b806-677ddbcccbf9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:48.456484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace222-ffcd-461f-8c19-b6d950edd1f2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:48.478037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 339/680] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 17 14:59:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:48.484405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0682-b5dc-4d8d-b806-677ddbcccbf9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:48.527642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:48.543025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7add-1c79-4766-95be-b4e2ce111a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:48.544389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7add-1c79-4766-95be-b4e2ce111a5b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:48.544878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7add-1c79-4766-95be-b4e2ce111a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:48.545636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7add-1c79-4766-95be-b4e2ce111a5b None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:48.546576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb7add-1c79-4766-95be-b4e2ce111a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:48.547134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb7add-1c79-4766-95be-b4e2ce111a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:48.549536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb7add-1c79-4766-95be-b4e2ce111a5b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:48.571767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 342/681] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:48.574499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7add-1c79-4766-95be-b4e2ce111a5b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:48.607175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:48.666799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0682-b5dc-4d8d-b806-677ddbcccbf9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:48.719952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7add-1c79-4766-95be-b4e2ce111a5b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:48.721056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692402e4-ca83-48da-9bfc-80f0bf2d25df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:48.721770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692402e4-ca83-48da-9bfc-80f0bf2d25df None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:48.722052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692402e4-ca83-48da-9bfc-80f0bf2d25df None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:48.722334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692402e4-ca83-48da-9bfc-80f0bf2d25df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:48.773155 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d650d58-9bf0-4c9c-80b9-e2add0a1b465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:48.774570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d650d58-9bf0-4c9c-80b9-e2add0a1b465 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:48.775363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d650d58-9bf0-4c9c-80b9-e2add0a1b465 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:48.776006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d650d58-9bf0-4c9c-80b9-e2add0a1b465 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:48.784752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d650d58-9bf0-4c9c-80b9-e2add0a1b465 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:48.786650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d650d58-9bf0-4c9c-80b9-e2add0a1b465 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-3d650d58-9bf0-4c9c-80b9-e2add0a1b465 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:48.804363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:48.805271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:48.806894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:48.806894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:48.806894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:48.806894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:48.806894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:48.806894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:48.806894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:48.806894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:48.813933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 343/682] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:48.815796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee89bc2-f314-4a7d-a3fd-3c65533944dd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:48.816336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee89bc2-f314-4a7d-a3fd-3c65533944dd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:48.816929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee89bc2-f314-4a7d-a3fd-3c65533944dd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:48.819310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 344/683] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:48.820348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee89bc2-f314-4a7d-a3fd-3c65533944dd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:48.827425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692402e4-ca83-48da-9bfc-80f0bf2d25df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:48.829060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692402e4-ca83-48da-9bfc-80f0bf2d25df None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:48.857348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:48.933820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:48.961479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee89bc2-f314-4a7d-a3fd-3c65533944dd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:48.961778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 340/684] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 14:59:48.963268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b8e55-7ef5-4fa6-869e-ae1b4b3e8b5d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:48.963575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b8e55-7ef5-4fa6-869e-ae1b4b3e8b5d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:48.963880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b8e55-7ef5-4fa6-869e-ae1b4b3e8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:48.984604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ca3b8e55-7ef5-4fa6-869e-ae1b4b3e8b5d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:48.985915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ca3b8e55-7ef5-4fa6-869e-ae1b4b3e8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:49.008565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af5ad4-c3f6-4d4b-86d9-7b7c1686e2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:49.009709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5ad4-c3f6-4d4b-86d9-7b7c1686e2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:49.010197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5ad4-c3f6-4d4b-86d9-7b7c1686e2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:49.010694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5ad4-c3f6-4d4b-86d9-7b7c1686e2a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:49.011729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af5ad4-c3f6-4d4b-86d9-7b7c1686e2a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:49.012291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af5ad4-c3f6-4d4b-86d9-7b7c1686e2a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:49.014051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af5ad4-c3f6-4d4b-86d9-7b7c1686e2a8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:49.027962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 345/685] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:49.029415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af5ad4-c3f6-4d4b-86d9-7b7c1686e2a8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:49.081714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 341/686] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:49.082772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b8e55-7ef5-4fa6-869e-ae1b4b3e8b5d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:49.147432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:49.182335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af5ad4-c3f6-4d4b-86d9-7b7c1686e2a8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:49.226941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b8e55-7ef5-4fa6-869e-ae1b4b3e8b5d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:49.229630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee5df2-2a3c-41fd-8140-a0d18d3dbd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:49.230465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee5df2-2a3c-41fd-8140-a0d18d3dbd14 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:49.230751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee5df2-2a3c-41fd-8140-a0d18d3dbd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:49.231025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee5df2-2a3c-41fd-8140-a0d18d3dbd14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:49.242462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:49.245278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee5df2-2a3c-41fd-8140-a0d18d3dbd14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:49.247255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee5df2-2a3c-41fd-8140-a0d18d3dbd14 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-bcee5df2-2a3c-41fd-8140-a0d18d3dbd14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:49.267385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:49.268529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:49.269677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:49.269677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:49.269677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:49.269677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:49.272785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 346/687] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:49.274726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee5df2-2a3c-41fd-8140-a0d18d3dbd14 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:49.277989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74df4d-846e-4502-9629-79704f618d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:49.278781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74df4d-846e-4502-9629-79704f618d02 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:49.279182 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74df4d-846e-4502-9629-79704f618d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:49.279561 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74df4d-846e-4502-9629-79704f618d02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:49.280513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74df4d-846e-4502-9629-79704f618d02 None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=20745118f9eb436096a323ba2d22e94f) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:49.280928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74df4d-846e-4502-9629-79704f618d02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:49.284449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74df4d-846e-4502-9629-79704f618d02 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:49.301452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 342/688] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:49 2022] GET /identity/v3/role_assignments?user.id=20745118f9eb436096a323ba2d22e94f&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:49.302597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74df4d-846e-4502-9629-79704f618d02 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:49.426697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee5df2-2a3c-41fd-8140-a0d18d3dbd14 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:49.483187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277f9c9-a2a9-41ca-8cbf-03e058f66556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:49.484006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277f9c9-a2a9-41ca-8cbf-03e058f66556 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:49.484281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277f9c9-a2a9-41ca-8cbf-03e058f66556 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:49.484550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277f9c9-a2a9-41ca-8cbf-03e058f66556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:49.525651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74df4d-846e-4502-9629-79704f618d02 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:49.526682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277f9c9-a2a9-41ca-8cbf-03e058f66556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:49.529326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277f9c9-a2a9-41ca-8cbf-03e058f66556 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:49.545840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0277f9c9-a2a9-41ca-8cbf-03e058f66556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:49.567222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:49.569086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:49.570732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:49.570732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:49.570732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:49.570732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:49.570732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 347/689] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:49.578266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277f9c9-a2a9-41ca-8cbf-03e058f66556 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:49.592159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4f0a7-fbd8-4a8b-a0ed-6c60a6033d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:49.592884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4f0a7-fbd8-4a8b-a0ed-6c60a6033d62 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:49.593168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4f0a7-fbd8-4a8b-a0ed-6c60a6033d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:49.593478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4f0a7-fbd8-4a8b-a0ed-6c60a6033d62 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:49.594423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4f0a7-fbd8-4a8b-a0ed-6c60a6033d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:49.594620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4f0a7-fbd8-4a8b-a0ed-6c60a6033d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:49.596234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4f0a7-fbd8-4a8b-a0ed-6c60a6033d62 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:49.618247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 343/690] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:49.624520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4f0a7-fbd8-4a8b-a0ed-6c60a6033d62 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:49.636441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:49.711507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277f9c9-a2a9-41ca-8cbf-03e058f66556 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:49.759140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f7a3b-1786-4d5f-aff7-a4de39b802eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:49.760243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f7a3b-1786-4d5f-aff7-a4de39b802eb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:49.760710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f7a3b-1786-4d5f-aff7-a4de39b802eb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:49.761154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f7a3b-1786-4d5f-aff7-a4de39b802eb None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:49.762449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f7a3b-1786-4d5f-aff7-a4de39b802eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:49.762963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f7a3b-1786-4d5f-aff7-a4de39b802eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:49.765335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f7a3b-1786-4d5f-aff7-a4de39b802eb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:49.781232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 348/691] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:49.786920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f7a3b-1786-4d5f-aff7-a4de39b802eb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:49.802567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4f0a7-fbd8-4a8b-a0ed-6c60a6033d62 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:49.883230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95812b3-64d1-4214-8202-80976d4cda25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:49.884074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95812b3-64d1-4214-8202-80976d4cda25 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:49.884356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95812b3-64d1-4214-8202-80976d4cda25 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:49.884667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95812b3-64d1-4214-8202-80976d4cda25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:49.898466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95812b3-64d1-4214-8202-80976d4cda25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:49.901154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95812b3-64d1-4214-8202-80976d4cda25 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e95812b3-64d1-4214-8202-80976d4cda25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:49.928935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:49.929946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:49.931056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:49.931056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:49.931056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:49.931056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:49.931056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:49.931056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:49.931056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:49.931056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:49.931056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 344/692] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:49.940301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95812b3-64d1-4214-8202-80976d4cda25 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:50.005599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:50.006799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f7a3b-1786-4d5f-aff7-a4de39b802eb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:50.012595 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:50.090783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95812b3-64d1-4214-8202-80976d4cda25 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:50.131063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9cda3-b377-4d9b-a789-afe02ebf7684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:50.132082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9cda3-b377-4d9b-a789-afe02ebf7684 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:50.132366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9cda3-b377-4d9b-a789-afe02ebf7684 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:50.132647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9cda3-b377-4d9b-a789-afe02ebf7684 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:50.133617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9cda3-b377-4d9b-a789-afe02ebf7684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:50.134003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9cda3-b377-4d9b-a789-afe02ebf7684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:50.135566 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9cda3-b377-4d9b-a789-afe02ebf7684 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:50.149099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 345/693] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:50.150841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953c1e9-c475-45bb-b6b9-56fe22d708d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:50.151543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c1e9-c475-45bb-b6b9-56fe22d708d8 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:50.151901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c1e9-c475-45bb-b6b9-56fe22d708d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:50.152105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c1e9-c475-45bb-b6b9-56fe22d708d8 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:50.152824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953c1e9-c475-45bb-b6b9-56fe22d708d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:50.161385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953c1e9-c475-45bb-b6b9-56fe22d708d8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:50.161720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9cda3-b377-4d9b-a789-afe02ebf7684 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:50.194041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 349/694] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 14:59:49 2022] POST /identity/v3/users => generated 254 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:59:50.305334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:50.325160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9cda3-b377-4d9b-a789-afe02ebf7684 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:50.327470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdb913-5122-4a00-a333-7f8e6fe421c4 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:50.328000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdb913-5122-4a00-a333-7f8e6fe421c4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:50.328478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdb913-5122-4a00-a333-7f8e6fe421c4 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:50.330477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 350/695] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:50.335640 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d9fe-2112-4724-afdb-2465b1616999 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:50.336276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d9fe-2112-4724-afdb-2465b1616999 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:50.336765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d9fe-2112-4724-afdb-2465b1616999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:50.366605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2227d9fe-2112-4724-afdb-2465b1616999 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:50.368168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2227d9fe-2112-4724-afdb-2465b1616999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:50.375330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf2556-f2b6-45d8-b688-df50e2a745dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:50.376030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf2556-f2b6-45d8-b688-df50e2a745dc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:50.376372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf2556-f2b6-45d8-b688-df50e2a745dc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:50.376655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf2556-f2b6-45d8-b688-df50e2a745dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:50.377542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf2556-f2b6-45d8-b688-df50e2a745dc None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=34feb70a340c4fc5b1fad510328c009b) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:50.377860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf2556-f2b6-45d8-b688-df50e2a745dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:50.379392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf2556-f2b6-45d8-b688-df50e2a745dc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:50.392050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 346/696] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:50 2022] GET /identity/v3/role_assignments?user.id=34feb70a340c4fc5b1fad510328c009b&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:50.468483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 351/697] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:50.493085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf2556-f2b6-45d8-b688-df50e2a745dc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:50.625164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf2556-f2b6-45d8-b688-df50e2a745dc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:50.663843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be4ab7-5760-4208-9115-7da4e506d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:50.664657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be4ab7-5760-4208-9115-7da4e506d19a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:50.664938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be4ab7-5760-4208-9115-7da4e506d19a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:50.665301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be4ab7-5760-4208-9115-7da4e506d19a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:50.677709 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be4ab7-5760-4208-9115-7da4e506d19a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f5be4ab7-5760-4208-9115-7da4e506d19a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:50.686352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:50.687348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:50.688230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 347/698] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:50.694040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227d9fe-2112-4724-afdb-2465b1616999 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:50.820311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:50.841078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227d9fe-2112-4724-afdb-2465b1616999 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:50.895011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcffde5-1a03-4313-ba3f-e98f789d3730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:50.895612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcffde5-1a03-4313-ba3f-e98f789d3730 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:50.895896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcffde5-1a03-4313-ba3f-e98f789d3730 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:50.896170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcffde5-1a03-4313-ba3f-e98f789d3730 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:50.896931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcffde5-1a03-4313-ba3f-e98f789d3730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:50.897253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcffde5-1a03-4313-ba3f-e98f789d3730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:50.898666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcffde5-1a03-4313-ba3f-e98f789d3730 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:50.913566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 352/699] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:50.919271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be4ab7-5760-4208-9115-7da4e506d19a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:50.951175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:51.084329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be4ab7-5760-4208-9115-7da4e506d19a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:51.137293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e94fa-fc98-49b9-a7b0-96cfc11854b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:51.138129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e94fa-fc98-49b9-a7b0-96cfc11854b6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:51.138413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e94fa-fc98-49b9-a7b0-96cfc11854b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:51.138725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e94fa-fc98-49b9-a7b0-96cfc11854b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:51.159614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e94fa-fc98-49b9-a7b0-96cfc11854b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:51.161076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e94fa-fc98-49b9-a7b0-96cfc11854b6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-610e94fa-fc98-49b9-a7b0-96cfc11854b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:51.185383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:51.186500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:51.187586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:51.187586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:51.187586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:51.187586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:51.187586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 348/700] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:51.193718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcffde5-1a03-4313-ba3f-e98f789d3730 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:51.378866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcffde5-1a03-4313-ba3f-e98f789d3730 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:51.427581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbeb51-ab31-41c0-8fab-d5f65281d41d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:51.427793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbeb51-ab31-41c0-8fab-d5f65281d41d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:51.428049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbeb51-ab31-41c0-8fab-d5f65281d41d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:51.434140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 349/701] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:51.441849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521d36b-425e-4b5e-bc89-1290cd59410b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:51.442223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521d36b-425e-4b5e-bc89-1290cd59410b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:51.442570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521d36b-425e-4b5e-bc89-1290cd59410b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:51.443365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7d806-59d8-4dd7-9689-d6cf7d1da560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:51.444033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7d806-59d8-4dd7-9689-d6cf7d1da560 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:51.444314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7d806-59d8-4dd7-9689-d6cf7d1da560 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:51.444586 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7d806-59d8-4dd7-9689-d6cf7d1da560 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:51.445662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7d806-59d8-4dd7-9689-d6cf7d1da560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:51.446138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7d806-59d8-4dd7-9689-d6cf7d1da560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:51.449084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7d806-59d8-4dd7-9689-d6cf7d1da560 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:51.466261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 353/702] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:51.472961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7d806-59d8-4dd7-9689-d6cf7d1da560 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:51.478355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3521d36b-425e-4b5e-bc89-1290cd59410b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:51.479850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3521d36b-425e-4b5e-bc89-1290cd59410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:51.529598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:51.599494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:51.608269 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 350/703] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:51.643675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521d36b-425e-4b5e-bc89-1290cd59410b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:51.699596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7d806-59d8-4dd7-9689-d6cf7d1da560 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:51.775187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4cc0b-b16b-4bf3-8c88-6cab01c4845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:51.776012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4cc0b-b16b-4bf3-8c88-6cab01c4845c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:51.776291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4cc0b-b16b-4bf3-8c88-6cab01c4845c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:51.776565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4cc0b-b16b-4bf3-8c88-6cab01c4845c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:51.804910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4cc0b-b16b-4bf3-8c88-6cab01c4845c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:51.807818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4cc0b-b16b-4bf3-8c88-6cab01c4845c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-07a4cc0b-b16b-4bf3-8c88-6cab01c4845c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:51.836765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:51.838110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:51.839221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:51.839221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:51.839221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:51.839221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:51.839221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:51.839221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:51.839221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:51.839221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:51.839221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 14:59:51.839221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:51.851920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 354/704] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 17 14:59:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:51.859234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4cc0b-b16b-4bf3-8c88-6cab01c4845c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:51.861567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521d36b-425e-4b5e-bc89-1290cd59410b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:51.943037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cb1f1-46bf-470f-b571-434d94e226a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:51.943904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cb1f1-46bf-470f-b571-434d94e226a5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:51.944334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cb1f1-46bf-470f-b571-434d94e226a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:51.944757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cb1f1-46bf-470f-b571-434d94e226a5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:51.949787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cb1f1-46bf-470f-b571-434d94e226a5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:51.954838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cb1f1-46bf-470f-b571-434d94e226a5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3b1cb1f1-46bf-470f-b571-434d94e226a5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:51.980714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:51.982622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:51.983549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 351/705] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Jun 17 14:59:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:51.991727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cb1f1-46bf-470f-b571-434d94e226a5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:52.022458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:52.073271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4cc0b-b16b-4bf3-8c88-6cab01c4845c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:52.091140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:52.127318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101de393-5fcf-4a0f-aaac-8788b9f42cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:52.128259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101de393-5fcf-4a0f-aaac-8788b9f42cdd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:52.128505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101de393-5fcf-4a0f-aaac-8788b9f42cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:52.128774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101de393-5fcf-4a0f-aaac-8788b9f42cdd None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:52.129782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101de393-5fcf-4a0f-aaac-8788b9f42cdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:52.130316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101de393-5fcf-4a0f-aaac-8788b9f42cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:52.132166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101de393-5fcf-4a0f-aaac-8788b9f42cdd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:52.149504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cb1f1-46bf-470f-b571-434d94e226a5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:52.159448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 355/706] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 17 14:59:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:52.160775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea9d27-6c93-41e7-ba80-783b99051c75 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:52.161058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea9d27-6c93-41e7-ba80-783b99051c75 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:52.161552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea9d27-6c93-41e7-ba80-783b99051c75 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:52.168046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 356/707] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:52.168046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea9d27-6c93-41e7-ba80-783b99051c75 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:52.209317 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97e5cd-c5b9-45cf-a7ff-912e0e9cf5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:52.209994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e5cd-c5b9-45cf-a7ff-912e0e9cf5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:52.210363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e5cd-c5b9-45cf-a7ff-912e0e9cf5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:52.210828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e5cd-c5b9-45cf-a7ff-912e0e9cf5a2 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:52.211868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97e5cd-c5b9-45cf-a7ff-912e0e9cf5a2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:52.212314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97e5cd-c5b9-45cf-a7ff-912e0e9cf5a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:52.214674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97e5cd-c5b9-45cf-a7ff-912e0e9cf5a2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:52.225270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 352/708] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 17 14:59:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:52.225270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43403a-2b06-438a-b3b7-3a7e632a5aa5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:52.225270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43403a-2b06-438a-b3b7-3a7e632a5aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:52.225270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43403a-2b06-438a-b3b7-3a7e632a5aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:52.242847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ff43403a-2b06-438a-b3b7-3a7e632a5aa5 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:52.244743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ff43403a-2b06-438a-b3b7-3a7e632a5aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:52.310757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea9d27-6c93-41e7-ba80-783b99051c75 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:52.345241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 353/709] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:52.345241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43403a-2b06-438a-b3b7-3a7e632a5aa5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:52.354037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:52.365486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f358a-c864-46f5-ba87-ad0b9b9787de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:52.366523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f358a-c864-46f5-ba87-ad0b9b9787de None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:52.367025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f358a-c864-46f5-ba87-ad0b9b9787de None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:52.367522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f358a-c864-46f5-ba87-ad0b9b9787de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:52.417426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:52.460197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f358a-c864-46f5-ba87-ad0b9b9787de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:52.462048 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f358a-c864-46f5-ba87-ad0b9b9787de None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:52.489201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43403a-2b06-438a-b3b7-3a7e632a5aa5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:52.546143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bf70d-4fb8-4ad7-8c2c-7748553fd399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:52.546870 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bf70d-4fb8-4ad7-8c2c-7748553fd399 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:52.547153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bf70d-4fb8-4ad7-8c2c-7748553fd399 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:52.547438 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bf70d-4fb8-4ad7-8c2c-7748553fd399 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:52.548464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bf70d-4fb8-4ad7-8c2c-7748553fd399 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:52.548780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bf70d-4fb8-4ad7-8c2c-7748553fd399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:52.550263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bf70d-4fb8-4ad7-8c2c-7748553fd399 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:52.565239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 354/710] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 17 14:59:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:52.565239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bf70d-4fb8-4ad7-8c2c-7748553fd399 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:52.611796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 357/711] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:52.620358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f358a-c864-46f5-ba87-ad0b9b9787de None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:52.684772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:52.815545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bf70d-4fb8-4ad7-8c2c-7748553fd399 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:52.836950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f358a-c864-46f5-ba87-ad0b9b9787de None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:52.841338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:52.865655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa4ca7-6b6d-4329-9047-74f6e9f9a1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:52.867073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa4ca7-6b6d-4329-9047-74f6e9f9a1ad None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:52.867547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa4ca7-6b6d-4329-9047-74f6e9f9a1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:52.868018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa4ca7-6b6d-4329-9047-74f6e9f9a1ad None admin] PATH_INFO: `/v3/services/network` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:52.869158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa4ca7-6b6d-4329-9047-74f6e9f9a1ad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:52.871834 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa4ca7-6b6d-4329-9047-74f6e9f9a1ad None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-67fa4ca7-6b6d-4329-9047-74f6e9f9a1ad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:52.887764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:52.888794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 14:59:52.889664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:52.890405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7a62a-9581-482d-9469-d9c953b99836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:52.890405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7a62a-9581-482d-9469-d9c953b99836 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:52.890405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7a62a-9581-482d-9469-d9c953b99836 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:52.890405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7a62a-9581-482d-9469-d9c953b99836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:52.892295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 355/712] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:52 2022] GET /identity/v3/services/network => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:52.898247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa4ca7-6b6d-4329-9047-74f6e9f9a1ad None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:52.907441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7a62a-9581-482d-9469-d9c953b99836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:52.909246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7a62a-9581-482d-9469-d9c953b99836 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e1b7a62a-9581-482d-9469-d9c953b99836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:52.939967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:52.940927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:52.941823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:52.941823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:52.941823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:52.941823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:52.941823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 358/713] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:52.943977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7a62a-9581-482d-9469-d9c953b99836 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:53.064617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa4ca7-6b6d-4329-9047-74f6e9f9a1ad None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:53.129163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:53.154922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d29f40-3603-4d51-b675-3545e2e8b074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:53.156038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29f40-3603-4d51-b675-3545e2e8b074 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:53.156494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29f40-3603-4d51-b675-3545e2e8b074 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:53.156978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29f40-3603-4d51-b675-3545e2e8b074 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:53.158369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d29f40-3603-4d51-b675-3545e2e8b074 None admin] RBAC: Adding query filter params (name=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:53.158915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d29f40-3603-4d51-b675-3545e2e8b074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:53.160659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d29f40-3603-4d51-b675-3545e2e8b074 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:53.163100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7a62a-9581-482d-9469-d9c953b99836 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:53.166432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 356/714] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 14:59:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:53.167788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e8fb-bc03-4f08-97ba-d6cf324f86e7 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:53.168080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e8fb-bc03-4f08-97ba-d6cf324f86e7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:53.168356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e8fb-bc03-4f08-97ba-d6cf324f86e7 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:53.175260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 357/715] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:53.175260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0e8fb-bc03-4f08-97ba-d6cf324f86e7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:53.208564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64e550-450a-4d30-9d48-3fc2b86b6018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:53.209291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e550-450a-4d30-9d48-3fc2b86b6018 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:53.209575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e550-450a-4d30-9d48-3fc2b86b6018 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:53.209848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e550-450a-4d30-9d48-3fc2b86b6018 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:53.210572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64e550-450a-4d30-9d48-3fc2b86b6018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:53.210871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64e550-450a-4d30-9d48-3fc2b86b6018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:53.212512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64e550-450a-4d30-9d48-3fc2b86b6018 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:53.226891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 359/716] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:53.228965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4c0cf-1c4e-4fa8-a835-32d2ab05abbb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:53.229284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4c0cf-1c4e-4fa8-a835-32d2ab05abbb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:53.229589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4c0cf-1c4e-4fa8-a835-32d2ab05abbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:53.243340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:53.248001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8fb4c0cf-1c4e-4fa8-a835-32d2ab05abbb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:53.249200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8fb4c0cf-1c4e-4fa8-a835-32d2ab05abbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:53.331646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0e8fb-bc03-4f08-97ba-d6cf324f86e7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:53.338444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 360/717] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:53.338444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4c0cf-1c4e-4fa8-a835-32d2ab05abbb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:53.413064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54e107-e301-480c-b674-ac78a1faa18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:53.414557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54e107-e301-480c-b674-ac78a1faa18f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:53.415289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54e107-e301-480c-b674-ac78a1faa18f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:53.416134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54e107-e301-480c-b674-ac78a1faa18f None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:53.417816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54e107-e301-480c-b674-ac78a1faa18f None admin] RBAC: Adding query filter params (type=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:53.418573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54e107-e301-480c-b674-ac78a1faa18f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:53.421419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54e107-e301-480c-b674-ac78a1faa18f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:53.429633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 358/718] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 14:59:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:53.431427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54e107-e301-480c-b674-ac78a1faa18f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:53.439272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:53.478812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4c0cf-1c4e-4fa8-a835-32d2ab05abbb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:53.533463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cec075-3d23-4615-ad2e-9927a3236578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:53.534702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec075-3d23-4615-ad2e-9927a3236578 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:53.535007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec075-3d23-4615-ad2e-9927a3236578 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:53.535303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec075-3d23-4615-ad2e-9927a3236578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:53.547415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cec075-3d23-4615-ad2e-9927a3236578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:53.549946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cec075-3d23-4615-ad2e-9927a3236578 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-77cec075-3d23-4615-ad2e-9927a3236578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:53.571106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:53.572659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:53.573633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:53.573633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:53.573633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:53.573633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:53.573633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:53.573633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:53.573633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:53.573633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:53.573633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 361/719] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:53.574676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95137003-1371-44be-9fd2-47c463c6d36d None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:53.574966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95137003-1371-44be-9fd2-47c463c6d36d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:53.575418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95137003-1371-44be-9fd2-47c463c6d36d None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:53.582136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 362/720] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:53.583208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95137003-1371-44be-9fd2-47c463c6d36d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:53.596128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54e107-e301-480c-b674-ac78a1faa18f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:53.612311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:53.644508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ad814-9bb0-45b4-ac4d-821dfda9aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:53.646169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ad814-9bb0-45b4-ac4d-821dfda9aef7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:53.646448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ad814-9bb0-45b4-ac4d-821dfda9aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:53.646727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ad814-9bb0-45b4-ac4d-821dfda9aef7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:53.660007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ad814-9bb0-45b4-ac4d-821dfda9aef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6c1ad814-9bb0-45b4-ac4d-821dfda9aef7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:53.668739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:53.670291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:53.671475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 359/721] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 14:59:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:53.672671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca22ad-a083-40b1-b64f-4b4331e60509 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:53.672671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca22ad-a083-40b1-b64f-4b4331e60509 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:53.672671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca22ad-a083-40b1-b64f-4b4331e60509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:53.702412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-80ca22ad-a083-40b1-b64f-4b4331e60509 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:53.704446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-80ca22ad-a083-40b1-b64f-4b4331e60509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:53.766202 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95137003-1371-44be-9fd2-47c463c6d36d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:53.805272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 360/722] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:53.806344 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca22ad-a083-40b1-b64f-4b4331e60509 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:53.813283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:53.822156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfd334-9f9e-4ede-aaab-033ed140604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:53.823208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfd334-9f9e-4ede-aaab-033ed140604e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:53.823667 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfd334-9f9e-4ede-aaab-033ed140604e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:53.824115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfd334-9f9e-4ede-aaab-033ed140604e None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:53.825400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfd334-9f9e-4ede-aaab-033ed140604e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:53.826210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfd334-9f9e-4ede-aaab-033ed140604e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:53.830072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfd334-9f9e-4ede-aaab-033ed140604e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:53.854438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 363/723] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:53.857433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfd334-9f9e-4ede-aaab-033ed140604e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:53.944153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:53.954374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca22ad-a083-40b1-b64f-4b4331e60509 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:54.012498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57785d2e-1a47-48ff-a224-ac6c946d868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:54.013542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785d2e-1a47-48ff-a224-ac6c946d868b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:54.013824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785d2e-1a47-48ff-a224-ac6c946d868b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:54.014097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785d2e-1a47-48ff-a224-ac6c946d868b None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:54.015154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57785d2e-1a47-48ff-a224-ac6c946d868b None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:54.015878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57785d2e-1a47-48ff-a224-ac6c946d868b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:54.017593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57785d2e-1a47-48ff-a224-ac6c946d868b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:54.018395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfd334-9f9e-4ede-aaab-033ed140604e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:54.034366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 361/724] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 14:59:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:54.035325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57785d2e-1a47-48ff-a224-ac6c946d868b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:54.067499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068d9fb-db7e-4899-b8b0-c972e9ab70ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:54.068455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068d9fb-db7e-4899-b8b0-c972e9ab70ff None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:54.068836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068d9fb-db7e-4899-b8b0-c972e9ab70ff None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:54.069247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068d9fb-db7e-4899-b8b0-c972e9ab70ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:54.082512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068d9fb-db7e-4899-b8b0-c972e9ab70ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4068d9fb-db7e-4899-b8b0-c972e9ab70ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:54.090947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:54.091927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:54.092853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:54.097024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 364/725] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:59:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:54.097977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068d9fb-db7e-4899-b8b0-c972e9ab70ff None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:54.160782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:54.167211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57785d2e-1a47-48ff-a224-ac6c946d868b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:54.218419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f5b6d-6dae-4d1c-b550-11290cc17098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:54.219917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5b6d-6dae-4d1c-b550-11290cc17098 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:54.220341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5b6d-6dae-4d1c-b550-11290cc17098 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:54.221007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5b6d-6dae-4d1c-b550-11290cc17098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:54.222268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f5b6d-6dae-4d1c-b550-11290cc17098 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=ca11a9d339bb4e799dc4e5531147ddda) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:54.223160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f5b6d-6dae-4d1c-b550-11290cc17098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:54.225307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f5b6d-6dae-4d1c-b550-11290cc17098 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:54.232530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068d9fb-db7e-4899-b8b0-c972e9ab70ff None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:54.233815 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 362/726] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:54 2022] GET /identity/v3/role_assignments?user.id=ca11a9d339bb4e799dc4e5531147ddda&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=8a6fe5045159487aa0119348cfe94387 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:54.236026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f5b6d-6dae-4d1c-b550-11290cc17098 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:54.278468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf497f-e62f-412c-bf39-a2f3691c6005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:54.279627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf497f-e62f-412c-bf39-a2f3691c6005 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:54.280074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf497f-e62f-412c-bf39-a2f3691c6005 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:54.280491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf497f-e62f-412c-bf39-a2f3691c6005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:54.295984 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf497f-e62f-412c-bf39-a2f3691c6005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:54.297768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf497f-e62f-412c-bf39-a2f3691c6005 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:54.317726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e0bf497f-e62f-412c-bf39-a2f3691c6005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:54.323421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:54.324581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:54.325992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:54.325992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:54.325992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:54.325992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:54.328254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 365/727] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:54.335769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf497f-e62f-412c-bf39-a2f3691c6005 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:54.514373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f5b6d-6dae-4d1c-b550-11290cc17098 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:54.573661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325eea7-4777-45ad-ab2d-50c109ad8b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:54.574603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325eea7-4777-45ad-ab2d-50c109ad8b09 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:54.575211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325eea7-4777-45ad-ab2d-50c109ad8b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:54.575949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325eea7-4777-45ad-ab2d-50c109ad8b09 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:54.576858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325eea7-4777-45ad-ab2d-50c109ad8b09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:54.577342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325eea7-4777-45ad-ab2d-50c109ad8b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:54.580111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325eea7-4777-45ad-ab2d-50c109ad8b09 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:54.604667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 363/728] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:54.614055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325eea7-4777-45ad-ab2d-50c109ad8b09 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:54.657100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf497f-e62f-412c-bf39-a2f3691c6005 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:54.665023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:54.707329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59011-d2e3-4290-8213-e10609977422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:54.710712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59011-d2e3-4290-8213-e10609977422 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:54.711151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59011-d2e3-4290-8213-e10609977422 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:54.714743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59011-d2e3-4290-8213-e10609977422 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:54.715687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59011-d2e3-4290-8213-e10609977422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:54.718285 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59011-d2e3-4290-8213-e10609977422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:54.720030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59011-d2e3-4290-8213-e10609977422 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:54.754930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 366/729] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:54.762937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59011-d2e3-4290-8213-e10609977422 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:54.889012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:54.932110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325eea7-4777-45ad-ab2d-50c109ad8b09 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:55.020026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ae88b-ea62-4b48-837d-9b9d1e22a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:55.022644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ae88b-ea62-4b48-837d-9b9d1e22a6da None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:55.024745 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ae88b-ea62-4b48-837d-9b9d1e22a6da None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:55.025292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ae88b-ea62-4b48-837d-9b9d1e22a6da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:55.049919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ae88b-ea62-4b48-837d-9b9d1e22a6da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:55.053052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ae88b-ea62-4b48-837d-9b9d1e22a6da None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:55.060793 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59011-d2e3-4290-8213-e10609977422 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-190ae88b-ea62-4b48-837d-9b9d1e22a6da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:55.095757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:55.096734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:55.097641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:55.097641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:55.097641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:55.097641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:55.102668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 364/730] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:55.106618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ae88b-ea62-4b48-837d-9b9d1e22a6da None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:55.149122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f40927-16f0-496e-affc-9ed1e8dd398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:55.150647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f40927-16f0-496e-affc-9ed1e8dd398c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:55.152954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f40927-16f0-496e-affc-9ed1e8dd398c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:55.153599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f40927-16f0-496e-affc-9ed1e8dd398c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:55.173992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f40927-16f0-496e-affc-9ed1e8dd398c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:55.177882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f40927-16f0-496e-affc-9ed1e8dd398c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-44f40927-16f0-496e-affc-9ed1e8dd398c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:55.211021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:55.212274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:55.213244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:55.213244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:55.213244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:55.213244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:55.213244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:55.213244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:55.213244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:55.213244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:55.213244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 14:59:55.213244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:55.223974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 367/731] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 17 14:59:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:55.229629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f40927-16f0-496e-affc-9ed1e8dd398c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:55.284724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:55.292260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ae88b-ea62-4b48-837d-9b9d1e22a6da None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:55.329111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac167a-1f26-42ba-9270-8e997d022bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:55.329750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac167a-1f26-42ba-9270-8e997d022bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:55.330055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac167a-1f26-42ba-9270-8e997d022bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:55.330359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac167a-1f26-42ba-9270-8e997d022bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:55.331054 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac167a-1f26-42ba-9270-8e997d022bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:55.331359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac167a-1f26-42ba-9270-8e997d022bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:55.333093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac167a-1f26-42ba-9270-8e997d022bc7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:55.343133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:55.347179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 365/732] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:55.349364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e3892-57cc-4347-bcbe-39b9e66ef84e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:55.349364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e3892-57cc-4347-bcbe-39b9e66ef84e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:55.349364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e3892-57cc-4347-bcbe-39b9e66ef84e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:55.354853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 366/733] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:55.355680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e3892-57cc-4347-bcbe-39b9e66ef84e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:55.386825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f40927-16f0-496e-affc-9ed1e8dd398c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:55.433511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbab8bf-c3ef-4d73-94a3-388ec9b66a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:55.434495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbab8bf-c3ef-4d73-94a3-388ec9b66a0f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:55.434977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbab8bf-c3ef-4d73-94a3-388ec9b66a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:55.435426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbab8bf-c3ef-4d73-94a3-388ec9b66a0f None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:55.436427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbab8bf-c3ef-4d73-94a3-388ec9b66a0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:55.436911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbab8bf-c3ef-4d73-94a3-388ec9b66a0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:55.439068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbab8bf-c3ef-4d73-94a3-388ec9b66a0f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:55.463299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 368/734] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 17 14:59:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:55.465695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11603d-5c9c-442a-b5e7-6a1729b31835 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:55.465978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11603d-5c9c-442a-b5e7-6a1729b31835 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:55.466251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11603d-5c9c-442a-b5e7-6a1729b31835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:55.470117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e3892-57cc-4347-bcbe-39b9e66ef84e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:55.483492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ac11603d-5c9c-442a-b5e7-6a1729b31835 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:55.484671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ac11603d-5c9c-442a-b5e7-6a1729b31835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:55.515539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd6088-79e4-4b9e-b732-7f48ce6bc3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:55.517110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd6088-79e4-4b9e-b732-7f48ce6bc3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:55.517732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd6088-79e4-4b9e-b732-7f48ce6bc3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:55.518462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd6088-79e4-4b9e-b732-7f48ce6bc3a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:55.528342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd6088-79e4-4b9e-b732-7f48ce6bc3a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:55.530142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd6088-79e4-4b9e-b732-7f48ce6bc3a2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-05fd6088-79e4-4b9e-b732-7f48ce6bc3a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:55.547893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:55.548884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:55.549848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:55.549848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:55.549848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:55.549848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:55.549848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:55.549848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:55.549848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:55.549848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:55.549848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 14:59:55.549848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:55.552306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 367/735] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:59:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:55.553922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd6088-79e4-4b9e-b732-7f48ce6bc3a2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:55.581436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 369/736] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 14:59:55.583275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11603d-5c9c-442a-b5e7-6a1729b31835 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:55.612968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:55.631674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:55.690211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd6088-79e4-4b9e-b732-7f48ce6bc3a2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:55.721287 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11603d-5c9c-442a-b5e7-6a1729b31835 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:55.739526 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e4b33-efe4-4c1c-8adf-bc31e8ffcc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:55.740817 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4b33-efe4-4c1c-8adf-bc31e8ffcc27 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:55.741271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4b33-efe4-4c1c-8adf-bc31e8ffcc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:55.741723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4b33-efe4-4c1c-8adf-bc31e8ffcc27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:55.761545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b263f-b809-41c9-a531-ed963b0965c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:55.762935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b263f-b809-41c9-a531-ed963b0965c6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:55.763421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b263f-b809-41c9-a531-ed963b0965c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:55.763904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b263f-b809-41c9-a531-ed963b0965c6 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:55.764945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b263f-b809-41c9-a531-ed963b0965c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:55.765751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b263f-b809-41c9-a531-ed963b0965c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:55.767440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b263f-b809-41c9-a531-ed963b0965c6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:55.790070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 370/737] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 17 14:59:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:55.791532 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b263f-b809-41c9-a531-ed963b0965c6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:55.836376 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e4b33-efe4-4c1c-8adf-bc31e8ffcc27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:55.838590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e4b33-efe4-4c1c-8adf-bc31e8ffcc27 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:55.869970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:55.910088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b263f-b809-41c9-a531-ed963b0965c6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:55.922616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:55.951154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4d739-fa56-4485-9645-f538ba0c7bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:55.952284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4d739-fa56-4485-9645-f538ba0c7bb8 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:55.952784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4d739-fa56-4485-9645-f538ba0c7bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:55.953285 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4d739-fa56-4485-9645-f538ba0c7bb8 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:55.954370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4d739-fa56-4485-9645-f538ba0c7bb8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:55.956136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4d739-fa56-4485-9645-f538ba0c7bb8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:55.983505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 368/739] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:55.984796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e4b33-efe4-4c1c-8adf-bc31e8ffcc27 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:55.988063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 371/739] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 14:59:55 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:59:55.990167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4d739-fa56-4485-9645-f538ba0c7bb8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:56.153788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e4b33-efe4-4c1c-8adf-bc31e8ffcc27 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:56.167119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4d739-fa56-4485-9645-f538ba0c7bb8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:56.203769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c62dd-777e-4401-8a34-e8f9f63078b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:56.204845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c62dd-777e-4401-8a34-e8f9f63078b5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:56.205334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c62dd-777e-4401-8a34-e8f9f63078b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:56.205809 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c62dd-777e-4401-8a34-e8f9f63078b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:56.206367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:56.219684 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf2348-d357-4e1f-ac17-792be3b72d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:56.220497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf2348-d357-4e1f-ac17-792be3b72d12 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:56.221099 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf2348-d357-4e1f-ac17-792be3b72d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:56.221408 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf2348-d357-4e1f-ac17-792be3b72d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:56.233070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf2348-d357-4e1f-ac17-792be3b72d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:56.234665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf2348-d357-4e1f-ac17-792be3b72d12 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:56.245182 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c9cf2348-d357-4e1f-ac17-792be3b72d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:56.256078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:56.257004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:56.258049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:56.258049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:56.258049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:56.258049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:56.258049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 372/740] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:56.259058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eea6f-8835-435a-986e-978f8dfdc1a8 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:56.259368 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eea6f-8835-435a-986e-978f8dfdc1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:56.259643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eea6f-8835-435a-986e-978f8dfdc1a8 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:56.260914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 373/741] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:56.266698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503767ed-d27f-4e77-84be-c033bff268a0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:56.266981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503767ed-d27f-4e77-84be-c033bff268a0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:56.267255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503767ed-d27f-4e77-84be-c033bff268a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:56.290572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-503767ed-d27f-4e77-84be-c033bff268a0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:56.291785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-503767ed-d27f-4e77-84be-c033bff268a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:56.307980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c62dd-777e-4401-8a34-e8f9f63078b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:56.309490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c62dd-777e-4401-8a34-e8f9f63078b5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:56.391847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 374/742] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 14:59:56.393610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503767ed-d27f-4e77-84be-c033bff268a0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:56.418348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 369/743] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 14:59:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 14:59:56.423587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c62dd-777e-4401-8a34-e8f9f63078b5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:56.501681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:56.520562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503767ed-d27f-4e77-84be-c033bff268a0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:56.531651 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:56.560084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181c1d4-b08d-419b-8429-f18061367f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:56.560930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c1d4-b08d-419b-8429-f18061367f47 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:56.561348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c1d4-b08d-419b-8429-f18061367f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:56.561717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c1d4-b08d-419b-8429-f18061367f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:56.562011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c62dd-777e-4401-8a34-e8f9f63078b5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:56.562620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181c1d4-b08d-419b-8429-f18061367f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:56.563016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181c1d4-b08d-419b-8429-f18061367f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:56.564492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181c1d4-b08d-419b-8429-f18061367f47 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:56.582118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 375/744] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:56.582118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181c1d4-b08d-419b-8429-f18061367f47 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:56.611102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f488e6e-19ec-4a68-973e-fbd977053ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:56.612870 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f488e6e-19ec-4a68-973e-fbd977053ff0 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:56.613290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f488e6e-19ec-4a68-973e-fbd977053ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:56.613664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f488e6e-19ec-4a68-973e-fbd977053ff0 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:56.614614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f488e6e-19ec-4a68-973e-fbd977053ff0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:56.616488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f488e6e-19ec-4a68-973e-fbd977053ff0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:56.637162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 370/745] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 14:59:56 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 14:59:56.638526 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f488e6e-19ec-4a68-973e-fbd977053ff0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:56.711169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181c1d4-b08d-419b-8429-f18061367f47 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:56.765436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256300c7-0314-4e01-bdf3-7a510c8b7e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:56.765664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f488e6e-19ec-4a68-973e-fbd977053ff0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:56.766649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256300c7-0314-4e01-bdf3-7a510c8b7e3d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:56.767076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256300c7-0314-4e01-bdf3-7a510c8b7e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:56.767811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256300c7-0314-4e01-bdf3-7a510c8b7e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:56.786331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256300c7-0314-4e01-bdf3-7a510c8b7e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:56.787838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:56.789270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256300c7-0314-4e01-bdf3-7a510c8b7e3d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-256300c7-0314-4e01-bdf3-7a510c8b7e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:56.813373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:56.814509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:56.815474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:56.815474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:56.815474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:56.815474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:56.815690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1bbd3-3f21-48ae-99ca-26f8b8187b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:56.816396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1bbd3-3f21-48ae-99ca-26f8b8187b90 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:56.816749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1bbd3-3f21-48ae-99ca-26f8b8187b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:56.817084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1bbd3-3f21-48ae-99ca-26f8b8187b90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:56.823128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 376/746] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:56.825063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce759-6e66-444f-8823-30109709cd8b None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:56.825881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce759-6e66-444f-8823-30109709cd8b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:56.826322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce759-6e66-444f-8823-30109709cd8b None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:56.827053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1bbd3-3f21-48ae-99ca-26f8b8187b90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:56.828345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 377/747] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:56.828867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1bbd3-3f21-48ae-99ca-26f8b8187b90 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:56.829588 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce759-6e66-444f-8823-30109709cd8b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-26b1bbd3-3f21-48ae-99ca-26f8b8187b90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:56.846003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:56.847030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:56.847981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:56.847981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:56.847981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:56.847981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:56.847981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:56.847981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:56.847981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:56.847981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:56.852728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 371/748] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:56.854608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8026a7-601e-49a2-88e3-c88fa7f2b522 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:56.855077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8026a7-601e-49a2-88e3-c88fa7f2b522 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:56.855360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8026a7-601e-49a2-88e3-c88fa7f2b522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:56.859471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:56.875714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cb8026a7-601e-49a2-88e3-c88fa7f2b522 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:56.876889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cb8026a7-601e-49a2-88e3-c88fa7f2b522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:56.955202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 372/749] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 14:59:56.956051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8026a7-601e-49a2-88e3-c88fa7f2b522 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:56.969836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce759-6e66-444f-8823-30109709cd8b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:57.016612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf76e5-9cbf-4fbd-a1ba-29541b1f6280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:57.017691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf76e5-9cbf-4fbd-a1ba-29541b1f6280 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:57.018171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf76e5-9cbf-4fbd-a1ba-29541b1f6280 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:57.019114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf76e5-9cbf-4fbd-a1ba-29541b1f6280 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:57.020054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf76e5-9cbf-4fbd-a1ba-29541b1f6280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:57.020936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf76e5-9cbf-4fbd-a1ba-29541b1f6280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:57.023153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf76e5-9cbf-4fbd-a1ba-29541b1f6280 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:57.039943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 378/750] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:57.041280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf76e5-9cbf-4fbd-a1ba-29541b1f6280 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:57.085512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8026a7-601e-49a2-88e3-c88fa7f2b522 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:57.093984 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:57.123299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352d1ee-2799-4f0f-8f33-b3098483544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:57.123949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352d1ee-2799-4f0f-8f33-b3098483544f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:57.124228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352d1ee-2799-4f0f-8f33-b3098483544f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:57.124501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352d1ee-2799-4f0f-8f33-b3098483544f None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:57.125329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352d1ee-2799-4f0f-8f33-b3098483544f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:57.125635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352d1ee-2799-4f0f-8f33-b3098483544f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:57.127068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352d1ee-2799-4f0f-8f33-b3098483544f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:57.147838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 373/751] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:57.148451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:57.148720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352d1ee-2799-4f0f-8f33-b3098483544f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:57.174283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf76e5-9cbf-4fbd-a1ba-29541b1f6280 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:57.212217 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7e88b-9a1e-4740-bf7c-5245b7e6f765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:57.213035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7e88b-9a1e-4740-bf7c-5245b7e6f765 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:57.213341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7e88b-9a1e-4740-bf7c-5245b7e6f765 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:57.213613 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7e88b-9a1e-4740-bf7c-5245b7e6f765 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:57.224966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7e88b-9a1e-4740-bf7c-5245b7e6f765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-36c7e88b-9a1e-4740-bf7c-5245b7e6f765 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 14:59:57.232920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:57.233885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 14:59:57.234708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:57.239163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 379/752] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 14:59:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:57.240075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7e88b-9a1e-4740-bf7c-5245b7e6f765 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:57.265164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352d1ee-2799-4f0f-8f33-b3098483544f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:57.301119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b29fc8-8a89-47cd-a894-e9940a9b90a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:57.301994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29fc8-8a89-47cd-a894-e9940a9b90a3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:57.302277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29fc8-8a89-47cd-a894-e9940a9b90a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:57.302551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29fc8-8a89-47cd-a894-e9940a9b90a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:57.310130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b29fc8-8a89-47cd-a894-e9940a9b90a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:57.311591 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b29fc8-8a89-47cd-a894-e9940a9b90a3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-07b29fc8-8a89-47cd-a894-e9940a9b90a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:57.327085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:57.328104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:57.328991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:57.328991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:57.328991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:57.328991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:57.328991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:57.328991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:57.328991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:57.328991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:57.328991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 374/753] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:57.330045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b29fc8-8a89-47cd-a894-e9940a9b90a3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:57.358548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:57.364592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7e88b-9a1e-4740-bf7c-5245b7e6f765 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:57.402454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51333-2d2c-4318-b0f5-88c43ffd1880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:57.403460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51333-2d2c-4318-b0f5-88c43ffd1880 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:57.403912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51333-2d2c-4318-b0f5-88c43ffd1880 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:57.404416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51333-2d2c-4318-b0f5-88c43ffd1880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:57.405490 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51333-2d2c-4318-b0f5-88c43ffd1880 None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=0ad87047a3e94b89b28b51d50ed9b5b9) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:57.406024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51333-2d2c-4318-b0f5-88c43ffd1880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:57.407656 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51333-2d2c-4318-b0f5-88c43ffd1880 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:57.411245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:57.415967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 380/754] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:57 2022] GET /identity/v3/role_assignments?user.id=0ad87047a3e94b89b28b51d50ed9b5b9&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:57.417074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51333-2d2c-4318-b0f5-88c43ffd1880 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:57.455405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b29fc8-8a89-47cd-a894-e9940a9b90a3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:57.530816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1fe2-f2dd-4720-a2d6-b61150966aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:57.531598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1fe2-f2dd-4720-a2d6-b61150966aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:57.531879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1fe2-f2dd-4720-a2d6-b61150966aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:57.532103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51333-2d2c-4318-b0f5-88c43ffd1880 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:57.532215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1fe2-f2dd-4720-a2d6-b61150966aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:57.532955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1fe2-f2dd-4720-a2d6-b61150966aa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:57.533282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1fe2-f2dd-4720-a2d6-b61150966aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:57.534868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1fe2-f2dd-4720-a2d6-b61150966aa6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:57.554120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 375/755] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 14:59:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:57.559197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1fe2-f2dd-4720-a2d6-b61150966aa6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:57.573780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5f918-fd83-4021-a621-8b3965460101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:57.574824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5f918-fd83-4021-a621-8b3965460101 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:57.575327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5f918-fd83-4021-a621-8b3965460101 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:57.576115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5f918-fd83-4021-a621-8b3965460101 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:57.577338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5f918-fd83-4021-a621-8b3965460101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:57.577863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5f918-fd83-4021-a621-8b3965460101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:57.579655 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5f918-fd83-4021-a621-8b3965460101 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:57.594660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 381/756] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:57.600267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5f918-fd83-4021-a621-8b3965460101 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:57.674790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:57.729715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5f918-fd83-4021-a621-8b3965460101 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:57.772759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cbcb3-dd4e-45d0-a7ad-e2cbd44e09c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:57.773844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cbcb3-dd4e-45d0-a7ad-e2cbd44e09c1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:57.774592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cbcb3-dd4e-45d0-a7ad-e2cbd44e09c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:57.775043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cbcb3-dd4e-45d0-a7ad-e2cbd44e09c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:57.776175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cbcb3-dd4e-45d0-a7ad-e2cbd44e09c1 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=34feb70a340c4fc5b1fad510328c009b) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:57.777080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cbcb3-dd4e-45d0-a7ad-e2cbd44e09c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:57.778883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cbcb3-dd4e-45d0-a7ad-e2cbd44e09c1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:57.781994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:57.794617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 382/757] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 14:59:57 2022] GET /identity/v3/role_assignments?user.id=34feb70a340c4fc5b1fad510328c009b&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=8a6fe5045159487aa0119348cfe94387 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:57.800104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1fe2-f2dd-4720-a2d6-b61150966aa6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:57.841069 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa74ad-2e83-4698-bd64-e1cb7e1e910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:57.842406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa74ad-2e83-4698-bd64-e1cb7e1e910f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:57.842842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa74ad-2e83-4698-bd64-e1cb7e1e910f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:57.843275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa74ad-2e83-4698-bd64-e1cb7e1e910f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:57.856778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa74ad-2e83-4698-bd64-e1cb7e1e910f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:57.858570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa74ad-2e83-4698-bd64-e1cb7e1e910f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2baa74ad-2e83-4698-bd64-e1cb7e1e910f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:57.878078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:57.879244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:57.880373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:57.880373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:57.880373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:57.880373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:57.882535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 376/758] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:57.888418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cbcb3-dd4e-45d0-a7ad-e2cbd44e09c1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:58.034226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cbcb3-dd4e-45d0-a7ad-e2cbd44e09c1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:58.060661 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:58.072891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8966f6-9ae2-49ec-8535-4ff17213b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:58.073851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8966f6-9ae2-49ec-8535-4ff17213b239 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:58.074273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8966f6-9ae2-49ec-8535-4ff17213b239 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:58.074688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8966f6-9ae2-49ec-8535-4ff17213b239 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:58.075903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8966f6-9ae2-49ec-8535-4ff17213b239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:58.076352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8966f6-9ae2-49ec-8535-4ff17213b239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:58.077925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8966f6-9ae2-49ec-8535-4ff17213b239 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:58.101137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 383/759] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:58.106432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa74ad-2e83-4698-bd64-e1cb7e1e910f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:58.239509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa74ad-2e83-4698-bd64-e1cb7e1e910f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:58.293433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ea527-75a6-4c5d-9f8a-929d0201e642 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:58.294263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ea527-75a6-4c5d-9f8a-929d0201e642 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:58.294685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ea527-75a6-4c5d-9f8a-929d0201e642 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:58.296196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 384/760] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 14:59:58.296428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae90a1-9425-47ae-934a-86c3fc492349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:58.297443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae90a1-9425-47ae-934a-86c3fc492349 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:58.297863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae90a1-9425-47ae-934a-86c3fc492349 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:58.298276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae90a1-9425-47ae-934a-86c3fc492349 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:58.301189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389387c-ac5b-47c7-931c-772dac7b8c93 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:58.301612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389387c-ac5b-47c7-931c-772dac7b8c93 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:58.302455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389387c-ac5b-47c7-931c-772dac7b8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:58.319335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae90a1-9425-47ae-934a-86c3fc492349 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:58.322815 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae90a1-9425-47ae-934a-86c3fc492349 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:58.329604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:58.329846 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0389387c-ac5b-47c7-931c-772dac7b8c93 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:58.331064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0389387c-ac5b-47c7-931c-772dac7b8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-21ae90a1-9425-47ae-934a-86c3fc492349 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 14:59:58.351183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:58.352245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:58.353410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:58.353410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:58.353410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 14:59:58.353410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 14:59:58.353410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 14:59:58.353410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 14:59:58.353410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 14:59:58.353410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 14:59:58.353410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 14:59:58.353410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:58.357171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 377/761] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 17 14:59:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:58.358565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae90a1-9425-47ae-934a-86c3fc492349 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:58.464506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 385/762] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 14:59:58.499451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389387c-ac5b-47c7-931c-772dac7b8c93 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:58.535679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae90a1-9425-47ae-934a-86c3fc492349 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:58.603262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb221649-d489-4ccd-9a44-a96c8f5e3aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:58.603862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb221649-d489-4ccd-9a44-a96c8f5e3aab None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:58.604139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb221649-d489-4ccd-9a44-a96c8f5e3aab None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:58.604413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb221649-d489-4ccd-9a44-a96c8f5e3aab None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:58.605283 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb221649-d489-4ccd-9a44-a96c8f5e3aab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:58.605593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb221649-d489-4ccd-9a44-a96c8f5e3aab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:58.607057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb221649-d489-4ccd-9a44-a96c8f5e3aab None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:58.650844 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 378/763] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 17 14:59:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:58.656036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb221649-d489-4ccd-9a44-a96c8f5e3aab None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:58.662878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389387c-ac5b-47c7-931c-772dac7b8c93 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:58.681389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:58.725970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae6b20-593f-42cb-8b4d-4dc665f90ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:58.726845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae6b20-593f-42cb-8b4d-4dc665f90ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:58.727119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae6b20-593f-42cb-8b4d-4dc665f90ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:58.727497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae6b20-593f-42cb-8b4d-4dc665f90ef3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:58.728211 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae6b20-593f-42cb-8b4d-4dc665f90ef3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:58.729824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae6b20-593f-42cb-8b4d-4dc665f90ef3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-bbae6b20-593f-42cb-8b4d-4dc665f90ef3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:58.757733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:58.758968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 14:59:58.759837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 14:59:58.769564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 386/764] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Jun 17 14:59:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:58.769853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:58.775853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae6b20-593f-42cb-8b4d-4dc665f90ef3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:58.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb221649-d489-4ccd-9a44-a96c8f5e3aab None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:58.939965 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70cc38-2e08-4333-b06a-e2f95c8256c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:58.940820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70cc38-2e08-4333-b06a-e2f95c8256c7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:58.941099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70cc38-2e08-4333-b06a-e2f95c8256c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:58.941391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70cc38-2e08-4333-b06a-e2f95c8256c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:58.965953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70cc38-2e08-4333-b06a-e2f95c8256c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:58.967464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70cc38-2e08-4333-b06a-e2f95c8256c7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.009560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae6b20-593f-42cb-8b4d-4dc665f90ef3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6d70cc38-2e08-4333-b06a-e2f95c8256c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 14:59:59.011946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:59.012848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:59.014097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 14:59:59.014097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 14:59:59.014097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 14:59:59.014097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:59.014097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 379/765] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 14:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 14:59:59.019044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70cc38-2e08-4333-b06a-e2f95c8256c7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:59.054725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3be250-c38e-4b52-ad33-e863e60f9c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:59.055820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3be250-c38e-4b52-ad33-e863e60f9c09 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.056275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3be250-c38e-4b52-ad33-e863e60f9c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.056858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3be250-c38e-4b52-ad33-e863e60f9c09 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.057800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3be250-c38e-4b52-ad33-e863e60f9c09 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:59.058309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3be250-c38e-4b52-ad33-e863e60f9c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:59.060044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3be250-c38e-4b52-ad33-e863e60f9c09 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.066048 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 387/766] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 17 14:59:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:59.071436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3be250-c38e-4b52-ad33-e863e60f9c09 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:59.125564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:59.163351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70cc38-2e08-4333-b06a-e2f95c8256c7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:59.176433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:59.191965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3be250-c38e-4b52-ad33-e863e60f9c09 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:59.202729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f7d1b-2338-4148-8bf3-7d7959d568fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:59.203745 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7d1b-2338-4148-8bf3-7d7959d568fd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.204196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7d1b-2338-4148-8bf3-7d7959d568fd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.204667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7d1b-2338-4148-8bf3-7d7959d568fd None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.205596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f7d1b-2338-4148-8bf3-7d7959d568fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:59.206203 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f7d1b-2338-4148-8bf3-7d7959d568fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:59.207941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f7d1b-2338-4148-8bf3-7d7959d568fd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.225349 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 380/767] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 14:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:59.227122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25a6e2-0f0e-4385-ac50-05c5210231e8 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.227673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25a6e2-0f0e-4385-ac50-05c5210231e8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.227889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bbeb7-11e7-4a6e-b65c-afdb3bd5d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:59.228230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25a6e2-0f0e-4385-ac50-05c5210231e8 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.229036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bbeb7-11e7-4a6e-b65c-afdb3bd5d06c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.229493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bbeb7-11e7-4a6e-b65c-afdb3bd5d06c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.229904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bbeb7-11e7-4a6e-b65c-afdb3bd5d06c None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.230099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 381/768] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 14:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 14:59:59.231047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bbeb7-11e7-4a6e-b65c-afdb3bd5d06c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:59.231302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25a6e2-0f0e-4385-ac50-05c5210231e8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:59.231786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bbeb7-11e7-4a6e-b65c-afdb3bd5d06c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:59.233430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bbeb7-11e7-4a6e-b65c-afdb3bd5d06c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.240403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 388/769] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 17 14:59:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 14:59:59.242173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b83dd-a5de-4a1c-86d9-0d1e4e92d636 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.242681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b83dd-a5de-4a1c-86d9-0d1e4e92d636 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.243194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b83dd-a5de-4a1c-86d9-0d1e4e92d636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.260842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e75b83dd-a5de-4a1c-86d9-0d1e4e92d636 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 14:59:59.262573 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e75b83dd-a5de-4a1c-86d9-0d1e4e92d636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 14:59:59.334136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 389/770] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 14:59:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 14:59:59.335811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b83dd-a5de-4a1c-86d9-0d1e4e92d636 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:59.341195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25a6e2-0f0e-4385-ac50-05c5210231e8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:59.372804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:59.381753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1947f3-6ecd-4acc-9999-781f0e69f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:59.382934 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1947f3-6ecd-4acc-9999-781f0e69f58e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.383351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1947f3-6ecd-4acc-9999-781f0e69f58e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.383859 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1947f3-6ecd-4acc-9999-781f0e69f58e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.392034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1947f3-6ecd-4acc-9999-781f0e69f58e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:59.393750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1947f3-6ecd-4acc-9999-781f0e69f58e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ce1947f3-6ecd-4acc-9999-781f0e69f58e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 14:59:59.409662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:59.410582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:59.411460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 14:59:59.411460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 14:59:59.411460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 14:59:59.411460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 14:59:59.411460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 14:59:59.411460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 14:59:59.411460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 14:59:59.411460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:59.413821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 382/771] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:59.419432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1947f3-6ecd-4acc-9999-781f0e69f58e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:59.444863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b83dd-a5de-4a1c-86d9-0d1e4e92d636 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:59.455716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:59.541873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1947f3-6ecd-4acc-9999-781f0e69f58e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:59.582171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0802d18-33e6-4939-ba4e-3ca769096bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:59.583389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802d18-33e6-4939-ba4e-3ca769096bad None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.583864 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802d18-33e6-4939-ba4e-3ca769096bad None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.584354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802d18-33e6-4939-ba4e-3ca769096bad None admin] PATH_INFO: `/v3/services/network` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.585230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0802d18-33e6-4939-ba4e-3ca769096bad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:59.587022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0802d18-33e6-4939-ba4e-3ca769096bad None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b0802d18-33e6-4939-ba4e-3ca769096bad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 14:59:59.601514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 14:59:59.602649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 14:59:59.603629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 14:59:59.606923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 383/772] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 14:59:59 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 14:59:59.608272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0802d18-33e6-4939-ba4e-3ca769096bad None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:59.619024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714f8b-3b04-4536-8099-8b07ac26db6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:59.620194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714f8b-3b04-4536-8099-8b07ac26db6e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.620194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714f8b-3b04-4536-8099-8b07ac26db6e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.620446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714f8b-3b04-4536-8099-8b07ac26db6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.621270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf714f8b-3b04-4536-8099-8b07ac26db6e None admin] RBAC: Adding query filter params (interface=public, service_id=410302b5b7b3431496bb8a18fad2625b, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:59.621583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf714f8b-3b04-4536-8099-8b07ac26db6e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:59.623157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf714f8b-3b04-4536-8099-8b07ac26db6e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.631485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 390/773] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 17 14:59:59 2022] GET /identity/v3/endpoints?service_id=410302b5b7b3431496bb8a18fad2625b&interface=public®ion_id=RegionOne => generated 194 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:59.632316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714f8b-3b04-4536-8099-8b07ac26db6e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:59.719810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:59.727778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0802d18-33e6-4939-ba4e-3ca769096bad None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:59.742914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714f8b-3b04-4536-8099-8b07ac26db6e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:59.745583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 14:59:59.765505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e233a42-0655-42eb-9bf9-5fe90ea6d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:59.766781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e233a42-0655-42eb-9bf9-5fe90ea6d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.767266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e233a42-0655-42eb-9bf9-5fe90ea6d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.767856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e233a42-0655-42eb-9bf9-5fe90ea6d6e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.769430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e233a42-0655-42eb-9bf9-5fe90ea6d6e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:59.769954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e233a42-0655-42eb-9bf9-5fe90ea6d6e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:59.772266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e233a42-0655-42eb-9bf9-5fe90ea6d6e6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.779038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6734-65e3-4002-8c47-97f54c029f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:59.779696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6734-65e3-4002-8c47-97f54c029f03 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.780159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6734-65e3-4002-8c47-97f54c029f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.780573 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6734-65e3-4002-8c47-97f54c029f03 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.781795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec6734-65e3-4002-8c47-97f54c029f03 None admin] RBAC: Adding query filter params (name=network) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 14:59:59.782240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec6734-65e3-4002-8c47-97f54c029f03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:59.783815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec6734-65e3-4002-8c47-97f54c029f03 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.792020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 384/774] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 14:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:59.793479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e233a42-0655-42eb-9bf9-5fe90ea6d6e6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:59.794822 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 391/775] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 14:59:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:59.796048 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6734-65e3-4002-8c47-97f54c029f03 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:59.921590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6734-65e3-4002-8c47-97f54c029f03 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:59.925062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e233a42-0655-42eb-9bf9-5fe90ea6d6e6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 14:59:59.967944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eae391-98a5-432c-9767-89f08650e334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:59.969194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eae391-98a5-432c-9767-89f08650e334 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.969698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eae391-98a5-432c-9767-89f08650e334 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.969975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eae391-98a5-432c-9767-89f08650e334 None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/ca11a9d339bb4e799dc4e5531147ddda/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.972055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a327075-0861-4df6-9948-e6bb96ee3214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 14:59:59.972196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eae391-98a5-432c-9767-89f08650e334 None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=ca11a9d339bb4e799dc4e5531147ddda, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:59.973023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327075-0861-4df6-9948-e6bb96ee3214 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 14:59:59.973484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327075-0861-4df6-9948-e6bb96ee3214 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 14:59:59.973704 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eae391-98a5-432c-9767-89f08650e334 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.974075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327075-0861-4df6-9948-e6bb96ee3214 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 14:59:59.974937 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a327075-0861-4df6-9948-e6bb96ee3214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 14:59:59.976847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a327075-0861-4df6-9948-e6bb96ee3214 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 14:59:59.985550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 385/776] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 17 14:59:59 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 14:59:59.986817 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a327075-0861-4df6-9948-e6bb96ee3214 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 14:59:59.990651 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 392/777] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 14:59:59 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/ca11a9d339bb4e799dc4e5531147ddda/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:00:00.017348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:00.121031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a327075-0861-4df6-9948-e6bb96ee3214 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:00.166244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a576ed5-a15a-4c3e-8bfa-d1151adb8eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:00.167221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a576ed5-a15a-4c3e-8bfa-d1151adb8eec None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:00.167646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a576ed5-a15a-4c3e-8bfa-d1151adb8eec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:00.168071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a576ed5-a15a-4c3e-8bfa-d1151adb8eec None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:00.168931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a576ed5-a15a-4c3e-8bfa-d1151adb8eec None admin] RBAC: Adding query filter params (type=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:00.169414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a576ed5-a15a-4c3e-8bfa-d1151adb8eec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:00.170989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a576ed5-a15a-4c3e-8bfa-d1151adb8eec None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:00.177460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 386/778] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 14:59:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:00.183914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eae391-98a5-432c-9767-89f08650e334 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:00.214363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:00.220813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0daf24-7216-4e14-af78-0b972af8ecc0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:00.221391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0daf24-7216-4e14-af78-0b972af8ecc0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:00.221832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0daf24-7216-4e14-af78-0b972af8ecc0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:00.223382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 387/779] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:00.229401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40afab-7c33-4346-9a41-c9423fea49f5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:00.229928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40afab-7c33-4346-9a41-c9423fea49f5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:00.230358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40afab-7c33-4346-9a41-c9423fea49f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:00.249980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1f40afab-7c33-4346-9a41-c9423fea49f5 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:00.251192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f40afab-7c33-4346-9a41-c9423fea49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:00.319077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eae391-98a5-432c-9767-89f08650e334 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:00.351089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 388/780] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:00.366869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b03332-4a07-4edd-b7d2-6269785e080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:00.368317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b03332-4a07-4edd-b7d2-6269785e080b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:00.368797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b03332-4a07-4edd-b7d2-6269785e080b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:00.369301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b03332-4a07-4edd-b7d2-6269785e080b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:00.370297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b03332-4a07-4edd-b7d2-6269785e080b None admin] RBAC: Adding query filter params (interface=public, service_id=0b891778dee946e68b9d3c3e1323c68f, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:00.370803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b03332-4a07-4edd-b7d2-6269785e080b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:00.372400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b03332-4a07-4edd-b7d2-6269785e080b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:00.374322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40afab-7c33-4346-9a41-c9423fea49f5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:00.379083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 393/781] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 17 15:00:00 2022] GET /identity/v3/endpoints?service_id=0b891778dee946e68b9d3c3e1323c68f&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:00.387254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b03332-4a07-4edd-b7d2-6269785e080b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:00.398921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:00.553598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:00.565178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b03332-4a07-4edd-b7d2-6269785e080b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:00.577599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40afab-7c33-4346-9a41-c9423fea49f5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:00.612857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2acd8-23bd-40d0-aebb-491865c6cf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:00.614245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2acd8-23bd-40d0-aebb-491865c6cf44 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:00.614988 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2acd8-23bd-40d0-aebb-491865c6cf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:00.615428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2acd8-23bd-40d0-aebb-491865c6cf44 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:00.618425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2acd8-23bd-40d0-aebb-491865c6cf44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:00.619994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2acd8-23bd-40d0-aebb-491865c6cf44 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:00.622680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b913f4e-186d-451d-857b-66a4e24fe4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:00.623570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b913f4e-186d-451d-857b-66a4e24fe4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:00.624185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b913f4e-186d-451d-857b-66a4e24fe4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:00.624539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b913f4e-186d-451d-857b-66a4e24fe4e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:00.627223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 394/782] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 17 15:00:00 2022] GET /identity/v3/services => generated 772 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:00.629183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452d966-dac0-4c97-a68e-663e01b85bc7 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:00.629646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452d966-dac0-4c97-a68e-663e01b85bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:00.630364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452d966-dac0-4c97-a68e-663e01b85bc7 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:00.632247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 395/783] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:00.638897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b913f4e-186d-451d-857b-66a4e24fe4e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:00.639150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba5666-e181-482d-9519-c9d91a64d97b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:00.639390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba5666-e181-482d-9519-c9d91a64d97b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:00.639758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba5666-e181-482d-9519-c9d91a64d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8b913f4e-186d-451d-857b-66a4e24fe4e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:00.651177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:00.652453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 15:00:00.653572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:00.656348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 389/784] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 15:00:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:00.661501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-44ba5666-e181-482d-9519-c9d91a64d97b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:00.662392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-44ba5666-e181-482d-9519-c9d91a64d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:00.663072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b913f4e-186d-451d-857b-66a4e24fe4e2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:00.738918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 396/785] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:00.762693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba5666-e181-482d-9519-c9d91a64d97b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:00.859756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:00.860346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:00.881912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba5666-e181-482d-9519-c9d91a64d97b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:00.911154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b913f4e-186d-451d-857b-66a4e24fe4e2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:00.933545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f288bd-ce9f-4449-b8b2-e5d076c99283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:00.934356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f288bd-ce9f-4449-b8b2-e5d076c99283 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:00.934636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f288bd-ce9f-4449-b8b2-e5d076c99283 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:00.934922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f288bd-ce9f-4449-b8b2-e5d076c99283 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:00.950330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f288bd-ce9f-4449-b8b2-e5d076c99283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:00.952003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a206-7be8-47a9-8613-1746b6fc4e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:00.952907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a206-7be8-47a9-8613-1746b6fc4e21 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:00.953436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a206-7be8-47a9-8613-1746b6fc4e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:00.953909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a206-7be8-47a9-8613-1746b6fc4e21 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:00.954857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9a206-7be8-47a9-8613-1746b6fc4e21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:00.955364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9a206-7be8-47a9-8613-1746b6fc4e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:00.956983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9a206-7be8-47a9-8613-1746b6fc4e21 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d6f288bd-ce9f-4449-b8b2-e5d076c99283 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:00.959349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:00.960262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:00.961107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 397/786] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:00.968354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f288bd-ce9f-4449-b8b2-e5d076c99283 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:00.972440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 390/787] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 15:00:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:00.977977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a206-7be8-47a9-8613-1746b6fc4e21 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:01.102750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f288bd-ce9f-4449-b8b2-e5d076c99283 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:01.138699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a587e-1265-4c8f-aaa0-329370a767f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:01.139268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a587e-1265-4c8f-aaa0-329370a767f1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:01.139551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a587e-1265-4c8f-aaa0-329370a767f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:01.139849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a587e-1265-4c8f-aaa0-329370a767f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:01.140593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a587e-1265-4c8f-aaa0-329370a767f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:01.140947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a587e-1265-4c8f-aaa0-329370a767f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:01.142410 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a587e-1265-4c8f-aaa0-329370a767f1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:01.151910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 398/788] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:01.161107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a587e-1265-4c8f-aaa0-329370a767f1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:01.165171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:01.180094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a206-7be8-47a9-8613-1746b6fc4e21 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:01.269933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a587e-1265-4c8f-aaa0-329370a767f1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:01.275942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7497fe-f286-4411-b44f-12934caf854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:01.277088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7497fe-f286-4411-b44f-12934caf854f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:01.277590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7497fe-f286-4411-b44f-12934caf854f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:01.278043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7497fe-f286-4411-b44f-12934caf854f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:01.283528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:01.295066 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7497fe-f286-4411-b44f-12934caf854f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:01.296557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7497fe-f286-4411-b44f-12934caf854f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:01.306689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b42f-c5aa-47dd-b161-66650bea0fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:01.307500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b42f-c5aa-47dd-b161-66650bea0fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:01.307782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b42f-c5aa-47dd-b161-66650bea0fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:01.308056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b42f-c5aa-47dd-b161-66650bea0fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-da7497fe-f286-4411-b44f-12934caf854f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:01.322189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:01.323149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:01.324029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:01.324029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:01.324029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:01.324029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:01.324247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 391/789] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:01.329232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943b42f-c5aa-47dd-b161-66650bea0fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:01.329232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943b42f-c5aa-47dd-b161-66650bea0fc6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:01.329482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7497fe-f286-4411-b44f-12934caf854f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1943b42f-c5aa-47dd-b161-66650bea0fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:01.361970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:01.362914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:01.363882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:01.363882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:01.363882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:01.363882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:01.363882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 399/790] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:01.377415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b42f-c5aa-47dd-b161-66650bea0fc6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:01.478869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7497fe-f286-4411-b44f-12934caf854f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:01.516826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed06dd-a7e3-4530-bffd-5343903d90d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:01.517601 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed06dd-a7e3-4530-bffd-5343903d90d4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:01.517883 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed06dd-a7e3-4530-bffd-5343903d90d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:01.518164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed06dd-a7e3-4530-bffd-5343903d90d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:01.518944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed06dd-a7e3-4530-bffd-5343903d90d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:01.519255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed06dd-a7e3-4530-bffd-5343903d90d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:01.520674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed06dd-a7e3-4530-bffd-5343903d90d4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:01.535170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 392/791] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:01.540824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed06dd-a7e3-4530-bffd-5343903d90d4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:01.548262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:01.592672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:01.611528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b42f-c5aa-47dd-b161-66650bea0fc6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:01.651932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed06dd-a7e3-4530-bffd-5343903d90d4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:01.679448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170ae35-e896-419e-9853-7320899bc87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:01.680148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ae35-e896-419e-9853-7320899bc87b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:01.680503 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ae35-e896-419e-9853-7320899bc87b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:01.680799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ae35-e896-419e-9853-7320899bc87b None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:01.681753 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170ae35-e896-419e-9853-7320899bc87b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:01.682073 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170ae35-e896-419e-9853-7320899bc87b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:01.683859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170ae35-e896-419e-9853-7320899bc87b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:01.692289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff0e0e-17bb-463b-8040-f0985b75fd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:01.693619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff0e0e-17bb-463b-8040-f0985b75fd48 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:01.694107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff0e0e-17bb-463b-8040-f0985b75fd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:01.694578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff0e0e-17bb-463b-8040-f0985b75fd48 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:01.704028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff0e0e-17bb-463b-8040-f0985b75fd48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:01.705997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff0e0e-17bb-463b-8040-f0985b75fd48 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:01.717734 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 400/792] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:01.726718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170ae35-e896-419e-9853-7320899bc87b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-90ff0e0e-17bb-463b-8040-f0985b75fd48 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:01.727873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:01.728842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:01.729862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:01.729862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:01.729862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:01.729862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:01.729862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:01.729862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:01.729862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:01.729862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:01.729862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 15:00:01.729862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:01.732433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 393/793] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 17 15:00:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:01.740245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff0e0e-17bb-463b-8040-f0985b75fd48 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:01.942537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff0e0e-17bb-463b-8040-f0985b75fd48 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:01.952866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:01.959233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170ae35-e896-419e-9853-7320899bc87b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:01.984150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b23485-e2e8-44d0-bf24-a31c8e8f3208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:01.985403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b23485-e2e8-44d0-bf24-a31c8e8f3208 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:01.985906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b23485-e2e8-44d0-bf24-a31c8e8f3208 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:01.986388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b23485-e2e8-44d0-bf24-a31c8e8f3208 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:01.987575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b23485-e2e8-44d0-bf24-a31c8e8f3208 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:01.987976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:01.988503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b23485-e2e8-44d0-bf24-a31c8e8f3208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:01.990515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b23485-e2e8-44d0-bf24-a31c8e8f3208 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:02.010674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 394/794] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 17 15:00:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:02.016269 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b23485-e2e8-44d0-bf24-a31c8e8f3208 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:02.027416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce60a9-21a2-49cf-b7b0-caacb553fe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:02.028235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce60a9-21a2-49cf-b7b0-caacb553fe00 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:02.028502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce60a9-21a2-49cf-b7b0-caacb553fe00 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:02.028807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce60a9-21a2-49cf-b7b0-caacb553fe00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:02.045353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce60a9-21a2-49cf-b7b0-caacb553fe00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:02.046661 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce60a9-21a2-49cf-b7b0-caacb553fe00 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1cce60a9-21a2-49cf-b7b0-caacb553fe00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:02.081047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:02.082078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:02.083004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:02.083004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:02.083004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:02.083004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:02.083004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:02.083004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:02.083004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:02.083004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:02.083004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 15:00:02.083004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:02.089166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 401/795] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:00:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:02.090422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce60a9-21a2-49cf-b7b0-caacb553fe00 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:02.138189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b23485-e2e8-44d0-bf24-a31c8e8f3208 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:02.224126 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadf0f0-2a69-4a6d-89cb-4e996c1ffe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:02.224953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadf0f0-2a69-4a6d-89cb-4e996c1ffe33 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:02.225265 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadf0f0-2a69-4a6d-89cb-4e996c1ffe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:02.225549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadf0f0-2a69-4a6d-89cb-4e996c1ffe33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:02.250436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadf0f0-2a69-4a6d-89cb-4e996c1ffe33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:02.252041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadf0f0-2a69-4a6d-89cb-4e996c1ffe33 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:02.269799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce60a9-21a2-49cf-b7b0-caacb553fe00 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-acadf0f0-2a69-4a6d-89cb-4e996c1ffe33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:02.281311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:02.282234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:02.283110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:02.283110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:02.283110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:02.283110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:02.283110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 395/796] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:02.289003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadf0f0-2a69-4a6d-89cb-4e996c1ffe33 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:02.317618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:02.348668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff3bb6-73b4-48aa-90af-8ac46fcfcd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:02.350500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff3bb6-73b4-48aa-90af-8ac46fcfcd3e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:02.353760 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff3bb6-73b4-48aa-90af-8ac46fcfcd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:02.354250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff3bb6-73b4-48aa-90af-8ac46fcfcd3e None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:02.355319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff3bb6-73b4-48aa-90af-8ac46fcfcd3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:02.357964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff3bb6-73b4-48aa-90af-8ac46fcfcd3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:02.359668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff3bb6-73b4-48aa-90af-8ac46fcfcd3e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:02.394256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 402/797] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 17 15:00:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:02.401509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff3bb6-73b4-48aa-90af-8ac46fcfcd3e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:02.447405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadf0f0-2a69-4a6d-89cb-4e996c1ffe33 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:02.469022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:02.513689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bad12-af45-4bd8-8243-76e599e0f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:02.514473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bad12-af45-4bd8-8243-76e599e0f4ac None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:02.514644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bad12-af45-4bd8-8243-76e599e0f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:02.514903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bad12-af45-4bd8-8243-76e599e0f4ac None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:02.515687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bad12-af45-4bd8-8243-76e599e0f4ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:02.515991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bad12-af45-4bd8-8243-76e599e0f4ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:02.517506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bad12-af45-4bd8-8243-76e599e0f4ac None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:02.544435 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 396/798] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:02.554266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bad12-af45-4bd8-8243-76e599e0f4ac None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:02.585508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff3bb6-73b4-48aa-90af-8ac46fcfcd3e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:02.651840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68077cb-0bfc-4fb0-8f05-bc877ce83562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:02.653029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68077cb-0bfc-4fb0-8f05-bc877ce83562 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:02.653564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68077cb-0bfc-4fb0-8f05-bc877ce83562 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:02.654038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68077cb-0bfc-4fb0-8f05-bc877ce83562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:02.682331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68077cb-0bfc-4fb0-8f05-bc877ce83562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:02.683841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68077cb-0bfc-4fb0-8f05-bc877ce83562 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:02.713728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c68077cb-0bfc-4fb0-8f05-bc877ce83562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:02.734301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:02.735278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:02.736198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:02.736198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:02.736198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:02.736198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:02.740700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 403/799] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:02.746365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68077cb-0bfc-4fb0-8f05-bc877ce83562 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:02.781989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bad12-af45-4bd8-8243-76e599e0f4ac None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:02.834699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5f41c-3f08-4b62-ac04-35b546ce01b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:02.835619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5f41c-3f08-4b62-ac04-35b546ce01b5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:02.835968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5f41c-3f08-4b62-ac04-35b546ce01b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:02.836313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5f41c-3f08-4b62-ac04-35b546ce01b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:02.844662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5f41c-3f08-4b62-ac04-35b546ce01b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:02.846204 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5f41c-3f08-4b62-ac04-35b546ce01b5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a8f5f41c-3f08-4b62-ac04-35b546ce01b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:02.871564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:02.873184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:02.874102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:02.874102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:02.874102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:02.874102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:02.874102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:02.874102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:02.874102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:02.874102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:02.877548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 397/800] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:02.879225 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd0fc-5b9e-42d5-84f4-dbdcbb44fe08 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:02.879703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd0fc-5b9e-42d5-84f4-dbdcbb44fe08 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:02.880279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd0fc-5b9e-42d5-84f4-dbdcbb44fe08 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:02.882097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 398/801] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:02.883436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183a5d-f682-44d1-a9f8-42e2ebf9b8e1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:02.883983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183a5d-f682-44d1-a9f8-42e2ebf9b8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:02.884430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183a5d-f682-44d1-a9f8-42e2ebf9b8e1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:02.889660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 399/802] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:02.890627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66183a5d-f682-44d1-a9f8-42e2ebf9b8e1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:02.899762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:02.918738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68077cb-0bfc-4fb0-8f05-bc877ce83562 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:02.966793 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98154bdc-b0dd-4cdf-8883-55ee6c34abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:02.967824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98154bdc-b0dd-4cdf-8883-55ee6c34abc2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:02.968322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98154bdc-b0dd-4cdf-8883-55ee6c34abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:02.968860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98154bdc-b0dd-4cdf-8883-55ee6c34abc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:02.969707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98154bdc-b0dd-4cdf-8883-55ee6c34abc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:02.970013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98154bdc-b0dd-4cdf-8883-55ee6c34abc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:02.971377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98154bdc-b0dd-4cdf-8883-55ee6c34abc2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:02.987784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 404/803] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:02.987784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85841c55-299f-4945-905f-f60d068dd26f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:02.987784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85841c55-299f-4945-905f-f60d068dd26f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:02.987784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85841c55-299f-4945-905f-f60d068dd26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.003595 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-85841c55-299f-4945-905f-f60d068dd26f None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:03.004790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-85841c55-299f-4945-905f-f60d068dd26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:03.032871 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66183a5d-f682-44d1-a9f8-42e2ebf9b8e1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:03.071613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cd16b-aae7-4cf7-b4b8-d4a0480d5f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:03.072276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cd16b-aae7-4cf7-b4b8-d4a0480d5f1b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.072557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cd16b-aae7-4cf7-b4b8-d4a0480d5f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.072834 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cd16b-aae7-4cf7-b4b8-d4a0480d5f1b None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.073666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cd16b-aae7-4cf7-b4b8-d4a0480d5f1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:03.073977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cd16b-aae7-4cf7-b4b8-d4a0480d5f1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:03.075751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cd16b-aae7-4cf7-b4b8-d4a0480d5f1b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:03.078583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:03.089881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 400/804] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:03.090750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 405/805] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:03.091313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8e1cf-65df-4cf6-9a2c-fa0f900485c4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.091598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8e1cf-65df-4cf6-9a2c-fa0f900485c4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.091874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8e1cf-65df-4cf6-9a2c-fa0f900485c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.092280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85841c55-299f-4945-905f-f60d068dd26f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:03.115538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-05a8e1cf-65df-4cf6-9a2c-fa0f900485c4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:03.117096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-05a8e1cf-65df-4cf6-9a2c-fa0f900485c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:03.186246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:03.214774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85841c55-299f-4945-905f-f60d068dd26f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:03.225437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 401/806] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:03.225437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8e1cf-65df-4cf6-9a2c-fa0f900485c4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:03.257279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5388c62-38fd-47da-9e8b-06ddab64e7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:03.258321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5388c62-38fd-47da-9e8b-06ddab64e7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.258856 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5388c62-38fd-47da-9e8b-06ddab64e7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.259575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5388c62-38fd-47da-9e8b-06ddab64e7d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.267186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5388c62-38fd-47da-9e8b-06ddab64e7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:03.268717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5388c62-38fd-47da-9e8b-06ddab64e7d8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f5388c62-38fd-47da-9e8b-06ddab64e7d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:03.283528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:03.284432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:03.285378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:03.285378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:03.285378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:03.285378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:03.285378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:03.285378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:03.285378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:03.285378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:03.285378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 406/807] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:03.286182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5388c62-38fd-47da-9e8b-06ddab64e7d8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:03.343046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8e1cf-65df-4cf6-9a2c-fa0f900485c4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:03.370754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:03.380227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd1641-5c16-497e-bdf3-f8dae3ff3581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:03.381142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1641-5c16-497e-bdf3-f8dae3ff3581 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.381475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1641-5c16-497e-bdf3-f8dae3ff3581 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.381749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1641-5c16-497e-bdf3-f8dae3ff3581 None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/0ad87047a3e94b89b28b51d50ed9b5b9/roles/eda8425696ad4dc7b29f5a2ab7961a35` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.389281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5388c62-38fd-47da-9e8b-06ddab64e7d8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:03.396517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd1641-5c16-497e-bdf3-f8dae3ff3581 None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=0ad87047a3e94b89b28b51d50ed9b5b9, role_id=eda8425696ad4dc7b29f5a2ab7961a35)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:03.398027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd1641-5c16-497e-bdf3-f8dae3ff3581 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:03.411513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 402/808] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 15:00:03 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/0ad87047a3e94b89b28b51d50ed9b5b9/roles/eda8425696ad4dc7b29f5a2ab7961a35 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:00:03.412336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd1641-5c16-497e-bdf3-f8dae3ff3581 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:03.436084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75550c4c-12f2-4add-81c2-8f36ab257625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:03.436906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75550c4c-12f2-4add-81c2-8f36ab257625 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.437187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75550c4c-12f2-4add-81c2-8f36ab257625 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.437487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75550c4c-12f2-4add-81c2-8f36ab257625 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.440622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:03.451239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75550c4c-12f2-4add-81c2-8f36ab257625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-75550c4c-12f2-4add-81c2-8f36ab257625 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:03.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:03.460384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:03.461273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 407/809] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:03.462646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e917e8-5f0d-476c-87b8-aa97bc1e258c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.462793 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e917e8-5f0d-476c-87b8-aa97bc1e258c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.463070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e917e8-5f0d-476c-87b8-aa97bc1e258c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.464422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 408/810] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:03.469544 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e917e8-5f0d-476c-87b8-aa97bc1e258c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:03.551494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd1641-5c16-497e-bdf3-f8dae3ff3581 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:03.604698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e917e8-5f0d-476c-87b8-aa97bc1e258c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:03.605650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29ca02-b71c-4b76-adc3-30934c143d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:03.606687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29ca02-b71c-4b76-adc3-30934c143d6c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.606980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29ca02-b71c-4b76-adc3-30934c143d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.607258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29ca02-b71c-4b76-adc3-30934c143d6c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.608902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29ca02-b71c-4b76-adc3-30934c143d6c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:03.610397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29ca02-b71c-4b76-adc3-30934c143d6c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7a29ca02-b71c-4b76-adc3-30934c143d6c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:03.625393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:03.626475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:03.627511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 403/811] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Jun 17 15:00:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:03.628421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29ca02-b71c-4b76-adc3-30934c143d6c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:03.646920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a118760-9150-4893-ae2e-9a8fe2cfbf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:03.647590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a118760-9150-4893-ae2e-9a8fe2cfbf77 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.647856 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a118760-9150-4893-ae2e-9a8fe2cfbf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.648127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a118760-9150-4893-ae2e-9a8fe2cfbf77 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.648952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a118760-9150-4893-ae2e-9a8fe2cfbf77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:03.649293 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a118760-9150-4893-ae2e-9a8fe2cfbf77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:03.650851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a118760-9150-4893-ae2e-9a8fe2cfbf77 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:03.669296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 409/812] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:03.671281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321a56-a255-445e-b5b4-3656bfe39fa8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.671777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321a56-a255-445e-b5b4-3656bfe39fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.672523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321a56-a255-445e-b5b4-3656bfe39fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.681888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:03.696072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-74321a56-a255-445e-b5b4-3656bfe39fa8 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:03.697811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-74321a56-a255-445e-b5b4-3656bfe39fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:03.753772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:03.759018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29ca02-b71c-4b76-adc3-30934c143d6c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:03.773653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 410/813] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:03.774643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74321a56-a255-445e-b5b4-3656bfe39fa8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:03.805024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7188-63a0-466b-b0a2-20e2ba32fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:03.806147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7188-63a0-466b-b0a2-20e2ba32fff2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.806622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7188-63a0-466b-b0a2-20e2ba32fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.806906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7188-63a0-466b-b0a2-20e2ba32fff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.807831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7188-63a0-466b-b0a2-20e2ba32fff2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:03.808144 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7188-63a0-466b-b0a2-20e2ba32fff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:03.809696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7188-63a0-466b-b0a2-20e2ba32fff2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:03.818923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 404/814] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:00:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:03.819573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7188-63a0-466b-b0a2-20e2ba32fff2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:03.891114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74321a56-a255-445e-b5b4-3656bfe39fa8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:03.928389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ddab8-c48a-4ea6-a943-7be51561b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:03.929106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ddab8-c48a-4ea6-a943-7be51561b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:03.929518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ddab8-c48a-4ea6-a943-7be51561b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:03.929796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ddab8-c48a-4ea6-a943-7be51561b8c2 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:03.930574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ddab8-c48a-4ea6-a943-7be51561b8c2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:03.930876 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ddab8-c48a-4ea6-a943-7be51561b8c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:03.932262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ddab8-c48a-4ea6-a943-7be51561b8c2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:03.942391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 411/815] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 17 15:00:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:03.942391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ddab8-c48a-4ea6-a943-7be51561b8c2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:03.952117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7188-63a0-466b-b0a2-20e2ba32fff2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:03.955062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:04.012031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922754d-0b50-4b92-b771-fa99ad1db378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:04.013268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922754d-0b50-4b92-b771-fa99ad1db378 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:04.013268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922754d-0b50-4b92-b771-fa99ad1db378 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:04.013488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922754d-0b50-4b92-b771-fa99ad1db378 None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/34feb70a340c4fc5b1fad510328c009b/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:04.015557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922754d-0b50-4b92-b771-fa99ad1db378 None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=34feb70a340c4fc5b1fad510328c009b, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:04.016985 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922754d-0b50-4b92-b771-fa99ad1db378 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:04.025762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:04.034156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 405/816] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 15:00:03 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/34feb70a340c4fc5b1fad510328c009b/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:00:04.035586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922754d-0b50-4b92-b771-fa99ad1db378 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:04.125447 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ddab8-c48a-4ea6-a943-7be51561b8c2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:04.170168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d767752-7929-4dfb-89a7-064316868227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:04.171007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d767752-7929-4dfb-89a7-064316868227 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:04.171286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d767752-7929-4dfb-89a7-064316868227 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:04.171560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d767752-7929-4dfb-89a7-064316868227 None admin] PATH_INFO: `/v3/services/network` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:04.172345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d767752-7929-4dfb-89a7-064316868227 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:04.173945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d767752-7929-4dfb-89a7-064316868227 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-6d767752-7929-4dfb-89a7-064316868227 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:04.188181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:04.189388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 15:00:04.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:04.193705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 412/817] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:03 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:04.194709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d767752-7929-4dfb-89a7-064316868227 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:04.205452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922754d-0b50-4b92-b771-fa99ad1db378 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:04.254915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f314-5e69-489e-b5bd-6d94a98c0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:04.255793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f314-5e69-489e-b5bd-6d94a98c0f3f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:04.256076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f314-5e69-489e-b5bd-6d94a98c0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:04.256920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f314-5e69-489e-b5bd-6d94a98c0f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:04.270328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793f314-5e69-489e-b5bd-6d94a98c0f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:04.271915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793f314-5e69-489e-b5bd-6d94a98c0f3f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c793f314-5e69-489e-b5bd-6d94a98c0f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:04.302640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:04.304609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:04.307018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:04.307018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:04.307018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:04.307018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:04.313373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 406/818] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:04.314665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f314-5e69-489e-b5bd-6d94a98c0f3f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:04.346479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d767752-7929-4dfb-89a7-064316868227 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:04.366344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:04.370786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:04.394952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac22864-14e3-4a10-b465-42a84df4415c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:04.395883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac22864-14e3-4a10-b465-42a84df4415c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:04.396820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac22864-14e3-4a10-b465-42a84df4415c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:04.397274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac22864-14e3-4a10-b465-42a84df4415c None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:04.398466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac22864-14e3-4a10-b465-42a84df4415c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:04.399105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac22864-14e3-4a10-b465-42a84df4415c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:04.401345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac22864-14e3-4a10-b465-42a84df4415c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:04.413441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 413/819] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 17 15:00:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:04.415522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac22864-14e3-4a10-b465-42a84df4415c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:04.469066 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f314-5e69-489e-b5bd-6d94a98c0f3f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:04.516190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab9102-7f57-4cb8-ae07-dee73b6c5afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:04.517139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9102-7f57-4cb8-ae07-dee73b6c5afd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:04.517467 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9102-7f57-4cb8-ae07-dee73b6c5afd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:04.517741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9102-7f57-4cb8-ae07-dee73b6c5afd None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:04.518687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab9102-7f57-4cb8-ae07-dee73b6c5afd None admin] RBAC: Adding query filter params (name=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:04.519003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab9102-7f57-4cb8-ae07-dee73b6c5afd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:04.520823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab9102-7f57-4cb8-ae07-dee73b6c5afd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:04.528262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 407/820] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 15:00:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:04.529125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab9102-7f57-4cb8-ae07-dee73b6c5afd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:04.537827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac22864-14e3-4a10-b465-42a84df4415c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:04.579477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57423482-f124-430f-8d2b-764c1a536e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:04.580309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57423482-f124-430f-8d2b-764c1a536e95 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:04.580701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57423482-f124-430f-8d2b-764c1a536e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:04.581042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57423482-f124-430f-8d2b-764c1a536e95 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:04.582084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57423482-f124-430f-8d2b-764c1a536e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:04.582462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57423482-f124-430f-8d2b-764c1a536e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:04.584030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57423482-f124-430f-8d2b-764c1a536e95 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:04.598331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 414/821] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:04.599465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57423482-f124-430f-8d2b-764c1a536e95 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:04.644017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:04.660797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab9102-7f57-4cb8-ae07-dee73b6c5afd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:04.685476 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:04.701515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bbf44-a93c-4502-9e09-90a2c7234191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:04.702523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bbf44-a93c-4502-9e09-90a2c7234191 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:04.703076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bbf44-a93c-4502-9e09-90a2c7234191 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:04.703541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bbf44-a93c-4502-9e09-90a2c7234191 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:04.704515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bbf44-a93c-4502-9e09-90a2c7234191 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:04.706227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bbf44-a93c-4502-9e09-90a2c7234191 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:04.713554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57423482-f124-430f-8d2b-764c1a536e95 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:04.743143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 408/822] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 17 15:00:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:04.744519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bbf44-a93c-4502-9e09-90a2c7234191 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:04.761084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca963f7-7a0c-49a3-a648-69e8dd80cea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:04.761820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca963f7-7a0c-49a3-a648-69e8dd80cea0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:04.762104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca963f7-7a0c-49a3-a648-69e8dd80cea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:04.762383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca963f7-7a0c-49a3-a648-69e8dd80cea0 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:04.763227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca963f7-7a0c-49a3-a648-69e8dd80cea0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:04.763545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca963f7-7a0c-49a3-a648-69e8dd80cea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:04.764970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca963f7-7a0c-49a3-a648-69e8dd80cea0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:04.771514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 415/823] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 15:00:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:04.777136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca963f7-7a0c-49a3-a648-69e8dd80cea0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:04.888222 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bbf44-a93c-4502-9e09-90a2c7234191 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:04.957412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf20f45-e375-4f34-9061-4f4e42b47944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:04.958465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf20f45-e375-4f34-9061-4f4e42b47944 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:04.958865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf20f45-e375-4f34-9061-4f4e42b47944 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:04.959147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf20f45-e375-4f34-9061-4f4e42b47944 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:04.961876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:04.971033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf20f45-e375-4f34-9061-4f4e42b47944 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:04.973396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf20f45-e375-4f34-9061-4f4e42b47944 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3cf20f45-e375-4f34-9061-4f4e42b47944 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:04.991168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:04.993081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:04.995028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 409/824] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 17 15:00:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:05.000541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf20f45-e375-4f34-9061-4f4e42b47944 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:05.071218 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:05.076973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca963f7-7a0c-49a3-a648-69e8dd80cea0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:05.121630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f8b1f-d562-4454-b460-caf2193ad96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:05.122312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f8b1f-d562-4454-b460-caf2193ad96a None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:05.122591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f8b1f-d562-4454-b460-caf2193ad96a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:05.122865 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f8b1f-d562-4454-b460-caf2193ad96a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:05.123625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f8b1f-d562-4454-b460-caf2193ad96a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:05.125005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f8b1f-d562-4454-b460-caf2193ad96a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:05.151138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 416/825] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 17 15:00:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:05.160952 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf20f45-e375-4f34-9061-4f4e42b47944 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:05.222946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aa257-1be8-4ec9-bf5e-d9bbe6b8762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:05.223554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa257-1be8-4ec9-bf5e-d9bbe6b8762e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:05.223825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa257-1be8-4ec9-bf5e-d9bbe6b8762e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:05.224103 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa257-1be8-4ec9-bf5e-d9bbe6b8762e None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:05.224972 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aa257-1be8-4ec9-bf5e-d9bbe6b8762e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:05.225314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aa257-1be8-4ec9-bf5e-d9bbe6b8762e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:05.226848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aa257-1be8-4ec9-bf5e-d9bbe6b8762e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:05.250625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 410/826] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 17 15:00:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:05.256945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f8b1f-d562-4454-b460-caf2193ad96a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:05.409628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f8b1f-d562-4454-b460-caf2193ad96a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:05.448019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356659e-c95f-423d-b755-b9d483b26652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:05.448730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356659e-c95f-423d-b755-b9d483b26652 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:05.449070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356659e-c95f-423d-b755-b9d483b26652 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:05.449389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356659e-c95f-423d-b755-b9d483b26652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:05.476871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:05.536484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356659e-c95f-423d-b755-b9d483b26652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:05.539298 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356659e-c95f-423d-b755-b9d483b26652 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:05.665761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 417/827] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:00:05.671441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aa257-1be8-4ec9-bf5e-d9bbe6b8762e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:05.745270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:05.775761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f3b1-a9fc-4b97-851d-e9f7c1823ad3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:05.776137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f3b1-a9fc-4b97-851d-e9f7c1823ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:05.776334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f3b1-a9fc-4b97-851d-e9f7c1823ad3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:05.778101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 418/828] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:05.784469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972312b2-a7d8-43e4-b2d0-a310cf5b03f0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:05.785095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972312b2-a7d8-43e4-b2d0-a310cf5b03f0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:05.785617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972312b2-a7d8-43e4-b2d0-a310cf5b03f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:05.805312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-972312b2-a7d8-43e4-b2d0-a310cf5b03f0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:05.807000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-972312b2-a7d8-43e4-b2d0-a310cf5b03f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:05.807755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aa257-1be8-4ec9-bf5e-d9bbe6b8762e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:05.857639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45003cda-1943-42fe-b958-167a405c0a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:05.858814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45003cda-1943-42fe-b958-167a405c0a88 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:05.859286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45003cda-1943-42fe-b958-167a405c0a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:05.859785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45003cda-1943-42fe-b958-167a405c0a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:05.871109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45003cda-1943-42fe-b958-167a405c0a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:05.872905 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45003cda-1943-42fe-b958-167a405c0a88 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:05.874221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-45003cda-1943-42fe-b958-167a405c0a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:05.894350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:05.895308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:05.896171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:05.896171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:05.896171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:05.896171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:05.896829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 419/829] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:05.898487 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 411/830] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:05.906235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972312b2-a7d8-43e4-b2d0-a310cf5b03f0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:05.926261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45003cda-1943-42fe-b958-167a405c0a88 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:06.035520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972312b2-a7d8-43e4-b2d0-a310cf5b03f0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:06.077190 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed76e9a-2f63-476a-b660-fb267efde8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:06.078383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed76e9a-2f63-476a-b660-fb267efde8bc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:06.078728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed76e9a-2f63-476a-b660-fb267efde8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:06.079090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed76e9a-2f63-476a-b660-fb267efde8bc None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:06.080161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed76e9a-2f63-476a-b660-fb267efde8bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:06.080531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed76e9a-2f63-476a-b660-fb267efde8bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:06.082054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed76e9a-2f63-476a-b660-fb267efde8bc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:06.090012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:06.096883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 420/831] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:06.104454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45003cda-1943-42fe-b958-167a405c0a88 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:06.107005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed76e9a-2f63-476a-b660-fb267efde8bc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:06.148730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569e12e-ce7d-45d6-a670-f834c77c998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:06.150367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569e12e-ce7d-45d6-a670-f834c77c998d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:06.150650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569e12e-ce7d-45d6-a670-f834c77c998d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:06.150934 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569e12e-ce7d-45d6-a670-f834c77c998d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:06.166304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569e12e-ce7d-45d6-a670-f834c77c998d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:06.181538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8569e12e-ce7d-45d6-a670-f834c77c998d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:06.184343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:06.186155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 15:00:06.187733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:06.192576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 412/832] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 15:00:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:06.199785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569e12e-ce7d-45d6-a670-f834c77c998d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:06.258413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed76e9a-2f63-476a-b660-fb267efde8bc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:06.306654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943f947-9d97-4a1a-b58c-a3e906cc17c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:06.307051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943f947-9d97-4a1a-b58c-a3e906cc17c5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:06.307258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943f947-9d97-4a1a-b58c-a3e906cc17c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:06.307538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943f947-9d97-4a1a-b58c-a3e906cc17c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:06.314826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943f947-9d97-4a1a-b58c-a3e906cc17c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:06.316280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943f947-9d97-4a1a-b58c-a3e906cc17c5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8943f947-9d97-4a1a-b58c-a3e906cc17c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:06.332547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:06.333552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:06.339782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:06.339782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:06.339782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:06.339782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:06.339782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:06.339782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:06.339782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:06.339782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:06.339782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 421/833] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:06.339782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943f947-9d97-4a1a-b58c-a3e906cc17c5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:06.350073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569e12e-ce7d-45d6-a670-f834c77c998d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:06.394199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68c0fc-e90b-4199-8c7a-1408721ba760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:06.396731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68c0fc-e90b-4199-8c7a-1408721ba760 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:06.397287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68c0fc-e90b-4199-8c7a-1408721ba760 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:06.397848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68c0fc-e90b-4199-8c7a-1408721ba760 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:06.399292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68c0fc-e90b-4199-8c7a-1408721ba760 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:06.399874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68c0fc-e90b-4199-8c7a-1408721ba760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:06.402280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68c0fc-e90b-4199-8c7a-1408721ba760 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:06.423234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 413/834] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 15:00:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:06.428030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68c0fc-e90b-4199-8c7a-1408721ba760 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:06.467731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:06.480546 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943f947-9d97-4a1a-b58c-a3e906cc17c5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:06.483432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:06.518860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775c853-8833-401a-a929-0d673efd57a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:06.519832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775c853-8833-401a-a929-0d673efd57a8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:06.520295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775c853-8833-401a-a929-0d673efd57a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:06.520648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775c853-8833-401a-a929-0d673efd57a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:06.521545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775c853-8833-401a-a929-0d673efd57a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:06.521925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775c853-8833-401a-a929-0d673efd57a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:06.524721 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775c853-8833-401a-a929-0d673efd57a8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:06.538913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 422/835] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:06.546420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775c853-8833-401a-a929-0d673efd57a8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:06.676409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775c853-8833-401a-a929-0d673efd57a8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:06.686148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68c0fc-e90b-4199-8c7a-1408721ba760 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:06.717736 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594ac8c-cb95-4dad-b2ab-6db12fb92b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:06.718511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594ac8c-cb95-4dad-b2ab-6db12fb92b4c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:06.718795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594ac8c-cb95-4dad-b2ab-6db12fb92b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:06.719076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594ac8c-cb95-4dad-b2ab-6db12fb92b4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:06.720040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594ac8c-cb95-4dad-b2ab-6db12fb92b4c None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=ca11a9d339bb4e799dc4e5531147ddda) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:06.720343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594ac8c-cb95-4dad-b2ab-6db12fb92b4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:06.721837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594ac8c-cb95-4dad-b2ab-6db12fb92b4c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:06.726778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a48cb-7979-4cd8-849a-572ee90b7c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:06.727744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a48cb-7979-4cd8-849a-572ee90b7c2f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:06.728124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a48cb-7979-4cd8-849a-572ee90b7c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:06.728266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a48cb-7979-4cd8-849a-572ee90b7c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:06.734829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 423/836] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:06 2022] GET /identity/v3/role_assignments?user.id=ca11a9d339bb4e799dc4e5531147ddda&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=8a6fe5045159487aa0119348cfe94387 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:06.734829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d71fef-72bd-4ba6-8143-3912658c7ce0 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:06.734829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d71fef-72bd-4ba6-8143-3912658c7ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:06.734829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d71fef-72bd-4ba6-8143-3912658c7ce0 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:06.737429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 424/837] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:06.741234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361c9a-e128-4934-ba5c-71c95c7dae46 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:06.741234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361c9a-e128-4934-ba5c-71c95c7dae46 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:06.741234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361c9a-e128-4934-ba5c-71c95c7dae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:06.747789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a48cb-7979-4cd8-849a-572ee90b7c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:06.749314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a48cb-7979-4cd8-849a-572ee90b7c2f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:06.766457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dd361c9a-e128-4934-ba5c-71c95c7dae46 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:06.767751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dd361c9a-e128-4934-ba5c-71c95c7dae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-976a48cb-7979-4cd8-849a-572ee90b7c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:06.771740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:06.772692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:06.773634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:06.773634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:06.773634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:06.773634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:06.777943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 414/838] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:06.778940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a48cb-7979-4cd8-849a-572ee90b7c2f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:06.815341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:06.885247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 425/839] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:06.885942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:06.907028 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361c9a-e128-4934-ba5c-71c95c7dae46 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:06.922500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a48cb-7979-4cd8-849a-572ee90b7c2f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:06.963614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de865e-86ca-489e-804c-8f82c6af96fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:06.964215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de865e-86ca-489e-804c-8f82c6af96fb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:06.964497 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de865e-86ca-489e-804c-8f82c6af96fb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:06.964771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de865e-86ca-489e-804c-8f82c6af96fb None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:06.966195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de865e-86ca-489e-804c-8f82c6af96fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:06.966195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de865e-86ca-489e-804c-8f82c6af96fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:06.967233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de865e-86ca-489e-804c-8f82c6af96fb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:06.984996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 415/840] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:06.992503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de865e-86ca-489e-804c-8f82c6af96fb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:07.046949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361c9a-e128-4934-ba5c-71c95c7dae46 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:07.111103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e835289-21f5-4e74-8ae8-09ea69c7ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:07.112574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e835289-21f5-4e74-8ae8-09ea69c7ad3d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:07.113079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e835289-21f5-4e74-8ae8-09ea69c7ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:07.113617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e835289-21f5-4e74-8ae8-09ea69c7ad3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:07.128732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e835289-21f5-4e74-8ae8-09ea69c7ad3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7e835289-21f5-4e74-8ae8-09ea69c7ad3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:07.136911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:07.137923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:07.138768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 426/841] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:00:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:07.146200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e835289-21f5-4e74-8ae8-09ea69c7ad3d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:07.165520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de865e-86ca-489e-804c-8f82c6af96fb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:07.174340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:07.208855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a68d6-1ee8-4ed0-96b7-267d907ca5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:07.209984 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a68d6-1ee8-4ed0-96b7-267d907ca5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:07.210743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a68d6-1ee8-4ed0-96b7-267d907ca5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:07.211201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a68d6-1ee8-4ed0-96b7-267d907ca5e5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:07.217275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:07.230989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a68d6-1ee8-4ed0-96b7-267d907ca5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:07.233847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a68d6-1ee8-4ed0-96b7-267d907ca5e5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-231a68d6-1ee8-4ed0-96b7-267d907ca5e5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:07.260763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:07.262923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:07.265038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:07.265038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:07.265038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:07.265038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:07.265038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:07.265038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:07.265038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:07.265038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:07.265038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 15:00:07.265038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:07.269073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 416/842] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 17 15:00:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:07.275493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a68d6-1ee8-4ed0-96b7-267d907ca5e5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:07.295444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e835289-21f5-4e74-8ae8-09ea69c7ad3d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:07.344980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d68c31-a0b9-426f-97b4-359759846c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:07.346097 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d68c31-a0b9-426f-97b4-359759846c7d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:07.346723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d68c31-a0b9-426f-97b4-359759846c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:07.347221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d68c31-a0b9-426f-97b4-359759846c7d None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:07.348230 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d68c31-a0b9-426f-97b4-359759846c7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:07.348765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d68c31-a0b9-426f-97b4-359759846c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:07.350498 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d68c31-a0b9-426f-97b4-359759846c7d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:07.361299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 427/843] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:00:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:07.374842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d68c31-a0b9-426f-97b4-359759846c7d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:07.383539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a68d6-1ee8-4ed0-96b7-267d907ca5e5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:07.420189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807326-a460-4782-bb2a-f94b365a02a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:07.420975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807326-a460-4782-bb2a-f94b365a02a4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:07.421279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807326-a460-4782-bb2a-f94b365a02a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:07.421559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807326-a460-4782-bb2a-f94b365a02a4 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:07.422891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7807326-a460-4782-bb2a-f94b365a02a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:07.422891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7807326-a460-4782-bb2a-f94b365a02a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:07.424357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7807326-a460-4782-bb2a-f94b365a02a4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:07.448994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 417/844] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 17 15:00:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:07.450012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807326-a460-4782-bb2a-f94b365a02a4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:07.478923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:07.501540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d68c31-a0b9-426f-97b4-359759846c7d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:07.507214 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:07.545070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bba45-8366-4c8c-99a2-43afe18a526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:07.546563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bba45-8366-4c8c-99a2-43afe18a526f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:07.547500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bba45-8366-4c8c-99a2-43afe18a526f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:07.547991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bba45-8366-4c8c-99a2-43afe18a526f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:07.561090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bba45-8366-4c8c-99a2-43afe18a526f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:07.563025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bba45-8366-4c8c-99a2-43afe18a526f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:07.563137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807326-a460-4782-bb2a-f94b365a02a4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-960bba45-8366-4c8c-99a2-43afe18a526f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:07.591210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:07.592345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:07.593451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:07.593451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:07.593451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:07.593451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:07.593733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 428/845] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:07.595576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383ddeb-8e1c-4539-a019-6beb9d905734 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:07.596006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383ddeb-8e1c-4539-a019-6beb9d905734 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:07.596409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383ddeb-8e1c-4539-a019-6beb9d905734 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:07.601383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 429/846] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:07.601383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383ddeb-8e1c-4539-a019-6beb9d905734 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:07.615309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a7654-a377-45c8-b2d4-ff458812050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:07.616292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a7654-a377-45c8-b2d4-ff458812050b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:07.616951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a7654-a377-45c8-b2d4-ff458812050b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:07.617661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a7654-a377-45c8-b2d4-ff458812050b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:07.690414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a7654-a377-45c8-b2d4-ff458812050b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:07.691922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a7654-a377-45c8-b2d4-ff458812050b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:07.719485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383ddeb-8e1c-4539-a019-6beb9d905734 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:07.748286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:07.750461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:07.756501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f36986-0c78-4c83-bcda-f9dfe79c939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:07.757501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f36986-0c78-4c83-bcda-f9dfe79c939e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:07.757780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f36986-0c78-4c83-bcda-f9dfe79c939e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:07.758084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f36986-0c78-4c83-bcda-f9dfe79c939e None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:07.759014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f36986-0c78-4c83-bcda-f9dfe79c939e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:07.759370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f36986-0c78-4c83-bcda-f9dfe79c939e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:07.760743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f36986-0c78-4c83-bcda-f9dfe79c939e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:07.773262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 430/847] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:07.773695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4715c-51ca-4bd6-ae56-8c696b50794e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:07.774132 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4715c-51ca-4bd6-ae56-8c696b50794e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:07.774411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4715c-51ca-4bd6-ae56-8c696b50794e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:07.791711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bdf4715c-51ca-4bd6-ae56-8c696b50794e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:07.792901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bdf4715c-51ca-4bd6-ae56-8c696b50794e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:07.812507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 418/848] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:00:07.814147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a7654-a377-45c8-b2d4-ff458812050b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:07.861977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 431/849] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:07.862811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4715c-51ca-4bd6-ae56-8c696b50794e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:07.950541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a7654-a377-45c8-b2d4-ff458812050b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:07.972879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4715c-51ca-4bd6-ae56-8c696b50794e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:07.992082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82768e3e-2303-41fa-9e9f-142eb6c502ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:07.993793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768e3e-2303-41fa-9e9f-142eb6c502ff None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:07.994340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768e3e-2303-41fa-9e9f-142eb6c502ff None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:07.994845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768e3e-2303-41fa-9e9f-142eb6c502ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:08.004020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82768e3e-2303-41fa-9e9f-142eb6c502ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:08.005929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82768e3e-2303-41fa-9e9f-142eb6c502ff None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:08.014234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-82768e3e-2303-41fa-9e9f-142eb6c502ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:08.022672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:08.023619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:08.024925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:08.024925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:08.024925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:08.024925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:08.024925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:08.024925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:08.024925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:08.024925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:08.024925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 15:00:08.024925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:08.029254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63822eaa-b679-4da4-afd5-051ed31f862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:08.029254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63822eaa-b679-4da4-afd5-051ed31f862b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:08.029254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63822eaa-b679-4da4-afd5-051ed31f862b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:08.029558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63822eaa-b679-4da4-afd5-051ed31f862b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:08.032053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 419/850] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:00:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:08.032920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82768e3e-2303-41fa-9e9f-142eb6c502ff None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:08.042454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63822eaa-b679-4da4-afd5-051ed31f862b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:08.043967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63822eaa-b679-4da4-afd5-051ed31f862b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:08.048921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-63822eaa-b679-4da4-afd5-051ed31f862b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:08.063911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:08.064907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:08.066242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:08.066242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:08.066242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:08.066242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:08.066242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 432/851] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:08.066242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63822eaa-b679-4da4-afd5-051ed31f862b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:08.174363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82768e3e-2303-41fa-9e9f-142eb6c502ff None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:08.206785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63822eaa-b679-4da4-afd5-051ed31f862b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:08.217451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea90d9-cb12-48b9-8141-b01aaea92cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:08.218286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea90d9-cb12-48b9-8141-b01aaea92cdc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:08.218570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea90d9-cb12-48b9-8141-b01aaea92cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:08.218868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea90d9-cb12-48b9-8141-b01aaea92cdc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:08.219518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea90d9-cb12-48b9-8141-b01aaea92cdc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:08.220925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea90d9-cb12-48b9-8141-b01aaea92cdc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-08ea90d9-cb12-48b9-8141-b01aaea92cdc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:08.233145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:08.234460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:08.235298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 420/852] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 15:00:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:08.236115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea90d9-cb12-48b9-8141-b01aaea92cdc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:08.254642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b06a7-c06b-488f-896a-0ff1e1bb5418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:08.255418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b06a7-c06b-488f-896a-0ff1e1bb5418 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:08.255771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b06a7-c06b-488f-896a-0ff1e1bb5418 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:08.256288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b06a7-c06b-488f-896a-0ff1e1bb5418 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:08.257309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b06a7-c06b-488f-896a-0ff1e1bb5418 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:08.257650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b06a7-c06b-488f-896a-0ff1e1bb5418 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:08.259815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b06a7-c06b-488f-896a-0ff1e1bb5418 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:08.292385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 433/853] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 17 15:00:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:08.292385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b06a7-c06b-488f-896a-0ff1e1bb5418 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:08.335260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:08.345373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:08.374957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea90d9-cb12-48b9-8141-b01aaea92cdc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:08.418681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcf57d-c598-4556-a405-9dc7b1a14672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:08.419467 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcf57d-c598-4556-a405-9dc7b1a14672 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:08.419749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcf57d-c598-4556-a405-9dc7b1a14672 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:08.420026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcf57d-c598-4556-a405-9dc7b1a14672 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:08.420755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcf57d-c598-4556-a405-9dc7b1a14672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:08.421061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcf57d-c598-4556-a405-9dc7b1a14672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:08.422473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcf57d-c598-4556-a405-9dc7b1a14672 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:08.425349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b06a7-c06b-488f-896a-0ff1e1bb5418 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:08.442534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 421/854] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:08.442534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcf57d-c598-4556-a405-9dc7b1a14672 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:08.474145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29c736-062e-4de7-a8be-aa4174f42489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:08.474848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c736-062e-4de7-a8be-aa4174f42489 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:08.475142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c736-062e-4de7-a8be-aa4174f42489 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:08.475419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c736-062e-4de7-a8be-aa4174f42489 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:08.476192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29c736-062e-4de7-a8be-aa4174f42489 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:08.476488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29c736-062e-4de7-a8be-aa4174f42489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:08.478025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29c736-062e-4de7-a8be-aa4174f42489 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:08.483181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 434/855] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 15:00:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:08.484029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29c736-062e-4de7-a8be-aa4174f42489 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:08.557605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcf57d-c598-4556-a405-9dc7b1a14672 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:08.595147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:08.602733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29c736-062e-4de7-a8be-aa4174f42489 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:08.613701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13248472-a912-40e7-ad58-3c655baf8fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:08.615075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13248472-a912-40e7-ad58-3c655baf8fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:08.615737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13248472-a912-40e7-ad58-3c655baf8fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:08.616397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13248472-a912-40e7-ad58-3c655baf8fd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:08.623743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:08.641722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114543-825e-4008-81d0-0d666913c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:08.642589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114543-825e-4008-81d0-0d666913c403 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:08.642880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114543-825e-4008-81d0-0d666913c403 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:08.643188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114543-825e-4008-81d0-0d666913c403 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:08.651417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114543-825e-4008-81d0-0d666913c403 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:08.652936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114543-825e-4008-81d0-0d666913c403 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0c114543-825e-4008-81d0-0d666913c403 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:08.668502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:08.669483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:08.675279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:08.675279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:08.675279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:08.675279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:08.675279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:08.675279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:08.675279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:08.675279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:08.675279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 435/856] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:08.675279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114543-825e-4008-81d0-0d666913c403 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:08.703461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13248472-a912-40e7-ad58-3c655baf8fd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:08.704923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13248472-a912-40e7-ad58-3c655baf8fd8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:08.800165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114543-825e-4008-81d0-0d666913c403 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:08.817567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 422/857] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:00:08.818696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13248472-a912-40e7-ad58-3c655baf8fd8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:08.843721 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c5984-0df6-4593-bda7-803be23155c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:08.844395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5984-0df6-4593-bda7-803be23155c3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:08.844681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5984-0df6-4593-bda7-803be23155c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:08.844960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5984-0df6-4593-bda7-803be23155c3 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:08.845699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c5984-0df6-4593-bda7-803be23155c3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:08.846013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c5984-0df6-4593-bda7-803be23155c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:08.847377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c5984-0df6-4593-bda7-803be23155c3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:08.852087 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 436/858] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 15:00:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:08.852821 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c5984-0df6-4593-bda7-803be23155c3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:08.869752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:08.892419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:08.945081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13248472-a912-40e7-ad58-3c655baf8fd8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:08.992511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346230c-b64c-442f-a45e-c9bb5d5e9c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:08.994007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346230c-b64c-442f-a45e-c9bb5d5e9c79 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:08.994516 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346230c-b64c-442f-a45e-c9bb5d5e9c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:08.994933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346230c-b64c-442f-a45e-c9bb5d5e9c79 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:08.996374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346230c-b64c-442f-a45e-c9bb5d5e9c79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:08.996940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346230c-b64c-442f-a45e-c9bb5d5e9c79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:08.999550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346230c-b64c-442f-a45e-c9bb5d5e9c79 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:09.014812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c5984-0df6-4593-bda7-803be23155c3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:09.026367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 423/859] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:09.028058 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346230c-b64c-442f-a45e-c9bb5d5e9c79 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:09.061467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46e110-693d-44d5-abf5-c8d8ca2f4692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:09.062371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46e110-693d-44d5-abf5-c8d8ca2f4692 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.062669 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46e110-693d-44d5-abf5-c8d8ca2f4692 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.062923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46e110-693d-44d5-abf5-c8d8ca2f4692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.080589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46e110-693d-44d5-abf5-c8d8ca2f4692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:09.082334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46e110-693d-44d5-abf5-c8d8ca2f4692 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4a46e110-693d-44d5-abf5-c8d8ca2f4692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:09.100448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:09.101649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:09.103531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:09.103531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:09.103531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:09.103531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:09.103531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 437/860] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:09.103531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d282b-a032-433f-a41c-abc825f86444 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.103531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d282b-a032-433f-a41c-abc825f86444 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.104007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d282b-a032-433f-a41c-abc825f86444 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.108944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 438/861] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:09.109831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d282b-a032-433f-a41c-abc825f86444 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:09.149902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:09.157769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346230c-b64c-442f-a45e-c9bb5d5e9c79 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:09.194476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:09.207676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecd07f-1ca8-49fc-b3bc-b7a345688e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:09.208328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecd07f-1ca8-49fc-b3bc-b7a345688e34 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.208607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecd07f-1ca8-49fc-b3bc-b7a345688e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.208898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecd07f-1ca8-49fc-b3bc-b7a345688e34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.209748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecd07f-1ca8-49fc-b3bc-b7a345688e34 None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=0ad87047a3e94b89b28b51d50ed9b5b9) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:09.210061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecd07f-1ca8-49fc-b3bc-b7a345688e34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:09.211893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecd07f-1ca8-49fc-b3bc-b7a345688e34 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:09.226130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 424/862] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:09 2022] GET /identity/v3/role_assignments?user.id=0ad87047a3e94b89b28b51d50ed9b5b9&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:09.229260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9267d1-2da1-4c53-a494-3e9a97fbe2e3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.230539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9267d1-2da1-4c53-a494-3e9a97fbe2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.231351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9267d1-2da1-4c53-a494-3e9a97fbe2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.234186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d282b-a032-433f-a41c-abc825f86444 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:09.257066 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9e9267d1-2da1-4c53-a494-3e9a97fbe2e3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:09.259155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9e9267d1-2da1-4c53-a494-3e9a97fbe2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:09.284513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18a7f0-1cf9-4f0c-937a-1f5d2de2d2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:09.285657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18a7f0-1cf9-4f0c-937a-1f5d2de2d2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.286170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18a7f0-1cf9-4f0c-937a-1f5d2de2d2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.286644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18a7f0-1cf9-4f0c-937a-1f5d2de2d2d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.288405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18a7f0-1cf9-4f0c-937a-1f5d2de2d2d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:09.289389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18a7f0-1cf9-4f0c-937a-1f5d2de2d2d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:09.291362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18a7f0-1cf9-4f0c-937a-1f5d2de2d2d3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:09.314305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 439/863] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:09.317351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18a7f0-1cf9-4f0c-937a-1f5d2de2d2d3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:09.353627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 425/864] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:09.370387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9267d1-2da1-4c53-a494-3e9a97fbe2e3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:09.463751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18a7f0-1cf9-4f0c-937a-1f5d2de2d2d3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:09.490807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:09.502567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9267d1-2da1-4c53-a494-3e9a97fbe2e3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:09.503238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:09.510248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c85587-2a1c-4806-9a80-0380b5aac764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:09.511139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c85587-2a1c-4806-9a80-0380b5aac764 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.511495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c85587-2a1c-4806-9a80-0380b5aac764 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.511772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c85587-2a1c-4806-9a80-0380b5aac764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.519830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c85587-2a1c-4806-9a80-0380b5aac764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:09.521302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c85587-2a1c-4806-9a80-0380b5aac764 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-30c85587-2a1c-4806-9a80-0380b5aac764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:09.540161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:09.541115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:09.542299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:09.542299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:09.542299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:09.542299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:09.542299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:09.542299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:09.542299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:09.542299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:09.542725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 440/865] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:09.549710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c85587-2a1c-4806-9a80-0380b5aac764 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:09.552339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b113c9e-5d0d-4dd7-808e-e916f9a6a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:09.553169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b113c9e-5d0d-4dd7-808e-e916f9a6a9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.553503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b113c9e-5d0d-4dd7-808e-e916f9a6a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.553779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b113c9e-5d0d-4dd7-808e-e916f9a6a9b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.554442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b113c9e-5d0d-4dd7-808e-e916f9a6a9b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:09.556633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b113c9e-5d0d-4dd7-808e-e916f9a6a9b4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0b113c9e-5d0d-4dd7-808e-e916f9a6a9b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:09.570389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:09.571967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:09.573445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 426/866] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Jun 17 15:00:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:09.579414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b113c9e-5d0d-4dd7-808e-e916f9a6a9b4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:09.673159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c85587-2a1c-4806-9a80-0380b5aac764 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:09.688922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b113c9e-5d0d-4dd7-808e-e916f9a6a9b4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:09.711939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545523c-8f46-4474-b39e-7b1877722ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:09.713006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545523c-8f46-4474-b39e-7b1877722ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.713578 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545523c-8f46-4474-b39e-7b1877722ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.714070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545523c-8f46-4474-b39e-7b1877722ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.715209 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545523c-8f46-4474-b39e-7b1877722ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:09.715720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545523c-8f46-4474-b39e-7b1877722ac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:09.717434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545523c-8f46-4474-b39e-7b1877722ac8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:09.724880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b24a8-455f-43ec-968d-6773767f719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:09.725625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b24a8-455f-43ec-968d-6773767f719d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.725863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b24a8-455f-43ec-968d-6773767f719d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.726140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b24a8-455f-43ec-968d-6773767f719d None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.726909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b24a8-455f-43ec-968d-6773767f719d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:09.727249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b24a8-455f-43ec-968d-6773767f719d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:09.728727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b24a8-455f-43ec-968d-6773767f719d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:09.738682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 427/867] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:09.740520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b24a8-455f-43ec-968d-6773767f719d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:09.740784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 441/868] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:09.742145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545523c-8f46-4474-b39e-7b1877722ac8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:09.773813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:09.804533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:09.849511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b24a8-455f-43ec-968d-6773767f719d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:09.861123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545523c-8f46-4474-b39e-7b1877722ac8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:09.888437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab582-ab47-46c9-9c05-3af85feb1fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:09.889031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab582-ab47-46c9-9c05-3af85feb1fec None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.889342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab582-ab47-46c9-9c05-3af85feb1fec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.889618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab582-ab47-46c9-9c05-3af85feb1fec None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.890323 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dab582-ab47-46c9-9c05-3af85feb1fec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:09.890625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dab582-ab47-46c9-9c05-3af85feb1fec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:09.891995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dab582-ab47-46c9-9c05-3af85feb1fec None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:09.905774 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 428/869] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:09.918335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d4d36-681b-4094-8df9-9c93c099546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:09.919508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d4d36-681b-4094-8df9-9c93c099546a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:09.919989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d4d36-681b-4094-8df9-9c93c099546a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:09.920460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d4d36-681b-4094-8df9-9c93c099546a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:09.921568 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d4d36-681b-4094-8df9-9c93c099546a None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=34feb70a340c4fc5b1fad510328c009b) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:09.922096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d4d36-681b-4094-8df9-9c93c099546a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:09.923923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d4d36-681b-4094-8df9-9c93c099546a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:09.937416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 442/870] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:09 2022] GET /identity/v3/role_assignments?user.id=34feb70a340c4fc5b1fad510328c009b&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=8a6fe5045159487aa0119348cfe94387 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:11.063617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944234c-6f46-4c7e-b501-053201200335 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:11.064164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944234c-6f46-4c7e-b501-053201200335 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:11.064164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944234c-6f46-4c7e-b501-053201200335 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:11.065776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 429/871] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:11.071594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607150f-ef95-480a-b480-e25368346343 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:11.072104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607150f-ef95-480a-b480-e25368346343 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:11.072408 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607150f-ef95-480a-b480-e25368346343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:11.089915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4607150f-ef95-480a-b480-e25368346343 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:11.091112 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4607150f-ef95-480a-b480-e25368346343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:11.167143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 443/872] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:11.188732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944234c-6f46-4c7e-b501-053201200335 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:11.277521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:11.298048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944234c-6f46-4c7e-b501-053201200335 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:11.334020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4fad4-4825-421b-94e9-a35f13916f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:11.335027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4fad4-4825-421b-94e9-a35f13916f1e None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:11.335517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4fad4-4825-421b-94e9-a35f13916f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:11.336049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4fad4-4825-421b-94e9-a35f13916f1e None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:11.337073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4fad4-4825-421b-94e9-a35f13916f1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:11.338669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4fad4-4825-421b-94e9-a35f13916f1e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:11.353697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 430/873] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 15:00:11 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:11.628618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e08c79-2453-4e3f-962b-cf623dd7098e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:11.628811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e08c79-2453-4e3f-962b-cf623dd7098e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:11.629133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e08c79-2453-4e3f-962b-cf623dd7098e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:11.630775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 444/874] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:11.636603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522b11-ed2b-4b00-acc7-c7353e298d30 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:11.636889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522b11-ed2b-4b00-acc7-c7353e298d30 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:11.637168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522b11-ed2b-4b00-acc7-c7353e298d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:11.655879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e2522b11-ed2b-4b00-acc7-c7353e298d30 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:11.657083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e2522b11-ed2b-4b00-acc7-c7353e298d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:11.745475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 431/875] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:11.768320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e08c79-2453-4e3f-962b-cf623dd7098e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:11.833333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:11.892071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e08c79-2453-4e3f-962b-cf623dd7098e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:11.932748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e1f15-5c6c-459d-a75f-b53eb3b70833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:11.933670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e1f15-5c6c-459d-a75f-b53eb3b70833 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:11.933948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e1f15-5c6c-459d-a75f-b53eb3b70833 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:11.934216 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e1f15-5c6c-459d-a75f-b53eb3b70833 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:11.945624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e1f15-5c6c-459d-a75f-b53eb3b70833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-385e1f15-5c6c-459d-a75f-b53eb3b70833 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:11.954530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:11.955495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:11.956337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 445/876] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 17 15:00:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:11.962109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522b11-ed2b-4b00-acc7-c7353e298d30 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:12.043562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:12.076941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522b11-ed2b-4b00-acc7-c7353e298d30 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:12.117822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7311cef-263e-4bd1-8ecd-abeb8d39ae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:12.118550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7311cef-263e-4bd1-8ecd-abeb8d39ae49 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.118928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7311cef-263e-4bd1-8ecd-abeb8d39ae49 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.119301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7311cef-263e-4bd1-8ecd-abeb8d39ae49 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.120108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7311cef-263e-4bd1-8ecd-abeb8d39ae49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:12.120425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7311cef-263e-4bd1-8ecd-abeb8d39ae49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:12.121886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7311cef-263e-4bd1-8ecd-abeb8d39ae49 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:12.132536 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 432/877] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 17 15:00:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:12.138393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e1f15-5c6c-459d-a75f-b53eb3b70833 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:12.175011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98c16c-bdd3-4460-9ea2-7fd82a04d33c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.175300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98c16c-bdd3-4460-9ea2-7fd82a04d33c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.175453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98c16c-bdd3-4460-9ea2-7fd82a04d33c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.176972 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 433/878] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:12.185253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8797-a5ca-455c-bd0e-a567a98adfc7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.185253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8797-a5ca-455c-bd0e-a567a98adfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.185253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8797-a5ca-455c-bd0e-a567a98adfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.207315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-74cc8797-a5ca-455c-bd0e-a567a98adfc7 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:12.209303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-74cc8797-a5ca-455c-bd0e-a567a98adfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:12.259040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e1f15-5c6c-459d-a75f-b53eb3b70833 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:12.268219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:12.306434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38508-8a75-427f-9f04-56b5add2ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:12.306854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 434/879] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:12.308262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab35fab-6e04-40ba-ac93-8c5fbab50c30 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.308560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab35fab-6e04-40ba-ac93-8c5fbab50c30 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.308832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab35fab-6e04-40ba-ac93-8c5fbab50c30 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.310345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38508-8a75-427f-9f04-56b5add2ac3d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.310458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 435/880] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:12.311527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38508-8a75-427f-9f04-56b5add2ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.311527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38508-8a75-427f-9f04-56b5add2ac3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.322777 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef1e16-e9e6-4fe1-80c2-9c4a39eb4e28 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.323397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef1e16-e9e6-4fe1-80c2-9c4a39eb4e28 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.323890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef1e16-e9e6-4fe1-80c2-9c4a39eb4e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.327027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38508-8a75-427f-9f04-56b5add2ac3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:12.328545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38508-8a75-427f-9f04-56b5add2ac3d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:12.343554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2cef1e16-e9e6-4fe1-80c2-9c4a39eb4e28 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:12.344781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2cef1e16-e9e6-4fe1-80c2-9c4a39eb4e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-25f38508-8a75-427f-9f04-56b5add2ac3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:12.349020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:12.349957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:12.351491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:12.351491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:12.351491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:12.351491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:12.351491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 446/881] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:12.351491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38508-8a75-427f-9f04-56b5add2ac3d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:12.417836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:12.429577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 436/882] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:12.430555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef1e16-e9e6-4fe1-80c2-9c4a39eb4e28 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:12.471866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38508-8a75-427f-9f04-56b5add2ac3d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:12.512528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f081a-425b-4818-906e-bddbb5f5236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:12.513621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f081a-425b-4818-906e-bddbb5f5236a None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.513621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f081a-425b-4818-906e-bddbb5f5236a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.513795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f081a-425b-4818-906e-bddbb5f5236a None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.514500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f081a-425b-4818-906e-bddbb5f5236a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:12.515877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f081a-425b-4818-906e-bddbb5f5236a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:12.531907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 447/883] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 15:00:12 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:12.532797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f081a-425b-4818-906e-bddbb5f5236a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:12.558843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef1e16-e9e6-4fe1-80c2-9c4a39eb4e28 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:12.581659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:12.621647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e85830-f381-4645-a62a-aad43d914290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:12.622348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e85830-f381-4645-a62a-aad43d914290 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.622629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e85830-f381-4645-a62a-aad43d914290 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.623244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e85830-f381-4645-a62a-aad43d914290 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.624026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e85830-f381-4645-a62a-aad43d914290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:12.625345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e85830-f381-4645-a62a-aad43d914290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:12.631789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e85830-f381-4645-a62a-aad43d914290 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:12.655222 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 437/884] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:12.657245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e85830-f381-4645-a62a-aad43d914290 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:12.665963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f081a-425b-4818-906e-bddbb5f5236a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:12.707675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30760474-ff99-4376-ad20-b1c4dc9f6534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:12.708936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760474-ff99-4376-ad20-b1c4dc9f6534 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.709345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760474-ff99-4376-ad20-b1c4dc9f6534 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.709716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760474-ff99-4376-ad20-b1c4dc9f6534 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.710449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30760474-ff99-4376-ad20-b1c4dc9f6534 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:12.712234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30760474-ff99-4376-ad20-b1c4dc9f6534 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:12.723668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-30760474-ff99-4376-ad20-b1c4dc9f6534 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:12.726482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:12.727879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:12.728720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 448/885] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:12.735694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30760474-ff99-4376-ad20-b1c4dc9f6534 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:12.803597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e85830-f381-4645-a62a-aad43d914290 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:12.845804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f369df-b10d-42d7-aa83-02b28dec18c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:12.846516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:12.847876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f369df-b10d-42d7-aa83-02b28dec18c5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.848368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f369df-b10d-42d7-aa83-02b28dec18c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.848845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f369df-b10d-42d7-aa83-02b28dec18c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.861050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f369df-b10d-42d7-aa83-02b28dec18c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:12.863528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f369df-b10d-42d7-aa83-02b28dec18c5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:12.870143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30760474-ff99-4376-ad20-b1c4dc9f6534 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d1f369df-b10d-42d7-aa83-02b28dec18c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:12.884479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:12.885524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:12.886483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:12.886483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:12.886483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:12.886483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:12.886483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:12.886483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:12.886483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:12.886483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:12.886483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 15:00:12.886483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:12.889402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 438/886] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 17 15:00:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:12.897191 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f369df-b10d-42d7-aa83-02b28dec18c5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:12.917003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbf652-1eed-44bf-8095-c056623fdef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:12.917003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf652-1eed-44bf-8095-c056623fdef1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:12.917003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf652-1eed-44bf-8095-c056623fdef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:12.917003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf652-1eed-44bf-8095-c056623fdef1 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:12.917480 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbf652-1eed-44bf-8095-c056623fdef1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:12.917480 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbf652-1eed-44bf-8095-c056623fdef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:12.918468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbf652-1eed-44bf-8095-c056623fdef1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:12.927292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 449/887] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 17 15:00:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:12.932479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbf652-1eed-44bf-8095-c056623fdef1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:13.051929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f369df-b10d-42d7-aa83-02b28dec18c5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:13.052249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbf652-1eed-44bf-8095-c056623fdef1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:13.063495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:13.094841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4b6ad-43b1-4a2b-a19e-4d0893c69e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:13.095448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335753a8-42f3-4d8f-bcff-69c43fcb09f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:13.095918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4b6ad-43b1-4a2b-a19e-4d0893c69e6b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:13.095918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4b6ad-43b1-4a2b-a19e-4d0893c69e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:13.096082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4b6ad-43b1-4a2b-a19e-4d0893c69e6b None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:13.096726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4b6ad-43b1-4a2b-a19e-4d0893c69e6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:13.097033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4b6ad-43b1-4a2b-a19e-4d0893c69e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:13.097336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335753a8-42f3-4d8f-bcff-69c43fcb09f0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:13.097800 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335753a8-42f3-4d8f-bcff-69c43fcb09f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:13.098237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335753a8-42f3-4d8f-bcff-69c43fcb09f0 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:13.098496 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4b6ad-43b1-4a2b-a19e-4d0893c69e6b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:13.099427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335753a8-42f3-4d8f-bcff-69c43fcb09f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:13.099950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335753a8-42f3-4d8f-bcff-69c43fcb09f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:13.101727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335753a8-42f3-4d8f-bcff-69c43fcb09f0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:13.109631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 450/888] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 17 15:00:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:13.123534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 439/889] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 17 15:00:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:13.129666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4b6ad-43b1-4a2b-a19e-4d0893c69e6b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:13.143353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:13.256365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4b6ad-43b1-4a2b-a19e-4d0893c69e6b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:13.298761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab86f8-4ca6-4a5b-aa38-477134a3aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:13.299420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab86f8-4ca6-4a5b-aa38-477134a3aee8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:13.299700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab86f8-4ca6-4a5b-aa38-477134a3aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:13.299976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab86f8-4ca6-4a5b-aa38-477134a3aee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:13.381958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab86f8-4ca6-4a5b-aa38-477134a3aee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:13.384616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab86f8-4ca6-4a5b-aa38-477134a3aee8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:13.398933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:13.500342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 451/890] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:13 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:00:13.506329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335753a8-42f3-4d8f-bcff-69c43fcb09f0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:13.607415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bef9c-0a2b-40fc-8ebb-79bbd2fb4405 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:13.607822 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bef9c-0a2b-40fc-8ebb-79bbd2fb4405 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:13.608274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bef9c-0a2b-40fc-8ebb-79bbd2fb4405 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:13.612154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 452/891] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:13.621383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bfeb9-5bdc-4d2a-a00c-a182ba944dd4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:13.621875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bfeb9-5bdc-4d2a-a00c-a182ba944dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:13.622354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bfeb9-5bdc-4d2a-a00c-a182ba944dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:13.637776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335753a8-42f3-4d8f-bcff-69c43fcb09f0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:13.642931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9b1bfeb9-5bdc-4d2a-a00c-a182ba944dd4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:13.644235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9b1bfeb9-5bdc-4d2a-a00c-a182ba944dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:13.676306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9e6ba-54b6-4acf-9e71-39ed7bcff648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:13.677163 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9e6ba-54b6-4acf-9e71-39ed7bcff648 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:13.677476 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9e6ba-54b6-4acf-9e71-39ed7bcff648 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:13.677749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9e6ba-54b6-4acf-9e71-39ed7bcff648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:13.689196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9e6ba-54b6-4acf-9e71-39ed7bcff648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:13.690821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9e6ba-54b6-4acf-9e71-39ed7bcff648 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-32e9e6ba-54b6-4acf-9e71-39ed7bcff648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:13.710545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:13.711866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:13.712742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:13.712742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:13.712742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:13.712742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:13.712742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 440/892] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:13.717759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9e6ba-54b6-4acf-9e71-39ed7bcff648 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:13.733527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 453/893] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:13.737523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:13.760199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bfeb9-5bdc-4d2a-a00c-a182ba944dd4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:13.825908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:13.850802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9e6ba-54b6-4acf-9e71-39ed7bcff648 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:13.874628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bfeb9-5bdc-4d2a-a00c-a182ba944dd4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:13.898237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026a26a-aff2-4596-9049-0755940cd1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:13.899533 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026a26a-aff2-4596-9049-0755940cd1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:13.900039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026a26a-aff2-4596-9049-0755940cd1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:13.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026a26a-aff2-4596-9049-0755940cd1f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:13.902003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026a26a-aff2-4596-9049-0755940cd1f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:13.902530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026a26a-aff2-4596-9049-0755940cd1f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:13.904796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026a26a-aff2-4596-9049-0755940cd1f3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:13.911203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e016121-6f76-4587-8e3f-784f8febabd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:13.912027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e016121-6f76-4587-8e3f-784f8febabd7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:13.912309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e016121-6f76-4587-8e3f-784f8febabd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:13.912586 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e016121-6f76-4587-8e3f-784f8febabd7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:13.913292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e016121-6f76-4587-8e3f-784f8febabd7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:13.915079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e016121-6f76-4587-8e3f-784f8febabd7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:13.925961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 441/894] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:13.927496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026a26a-aff2-4596-9049-0755940cd1f3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9e016121-6f76-4587-8e3f-784f8febabd7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:13.937899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:13.938971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 15:00:13.939800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:13.944343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 454/895] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 15:00:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:13.946299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e016121-6f76-4587-8e3f-784f8febabd7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:14.044918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:14.079670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026a26a-aff2-4596-9049-0755940cd1f3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:14.088464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e016121-6f76-4587-8e3f-784f8febabd7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:14.092654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:14.123401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e518e4-80c5-4b13-84f1-6bfd0d74092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:14.124238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e518e4-80c5-4b13-84f1-6bfd0d74092b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:14.124692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e518e4-80c5-4b13-84f1-6bfd0d74092b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:14.124799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e518e4-80c5-4b13-84f1-6bfd0d74092b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:14.132128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e518e4-80c5-4b13-84f1-6bfd0d74092b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:14.133553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e518e4-80c5-4b13-84f1-6bfd0d74092b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:14.138725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669377d-8488-4e21-812a-08349e68abef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:14.139696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669377d-8488-4e21-812a-08349e68abef None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:14.140316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669377d-8488-4e21-812a-08349e68abef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:14.140896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669377d-8488-4e21-812a-08349e68abef None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:14.141835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669377d-8488-4e21-812a-08349e68abef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:14.142442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669377d-8488-4e21-812a-08349e68abef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:14.144004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669377d-8488-4e21-812a-08349e68abef None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-72e518e4-80c5-4b13-84f1-6bfd0d74092b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:14.148558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:14.149936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:14.150816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:14.150816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:14.150816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:14.150816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:14.150816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:14.150816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:14.150816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:14.150816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:14.150816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 442/896] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:14.151299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 455/897] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 15:00:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:14.157077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e518e4-80c5-4b13-84f1-6bfd0d74092b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:14.157267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669377d-8488-4e21-812a-08349e68abef None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:14.281119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669377d-8488-4e21-812a-08349e68abef None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:14.288589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e518e4-80c5-4b13-84f1-6bfd0d74092b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:14.328051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d200f0-5116-463e-beac-48e92ae7150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:14.328834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d200f0-5116-463e-beac-48e92ae7150a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:14.329179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d200f0-5116-463e-beac-48e92ae7150a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:14.329575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d200f0-5116-463e-beac-48e92ae7150a None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:14.330436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d200f0-5116-463e-beac-48e92ae7150a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:14.330809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d200f0-5116-463e-beac-48e92ae7150a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:14.332324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d200f0-5116-463e-beac-48e92ae7150a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:14.336710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c3d75-de22-415f-95ff-923bc8bf0e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:14.337885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3d75-de22-415f-95ff-923bc8bf0e6a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:14.338350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3d75-de22-415f-95ff-923bc8bf0e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:14.338803 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3d75-de22-415f-95ff-923bc8bf0e6a None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:14.339694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c3d75-de22-415f-95ff-923bc8bf0e6a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:14.340202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c3d75-de22-415f-95ff-923bc8bf0e6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:14.342544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c3d75-de22-415f-95ff-923bc8bf0e6a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:14.346132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:14.347234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 456/898] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:14.352313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 443/899] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 15:00:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:14.358311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d200f0-5116-463e-beac-48e92ae7150a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:14.359644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c3d75-de22-415f-95ff-923bc8bf0e6a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:14.398006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:14.488812 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c3d75-de22-415f-95ff-923bc8bf0e6a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:14.505366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d200f0-5116-463e-beac-48e92ae7150a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:14.528046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a1c8e-04d7-449a-9751-547dbcf8f060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:14.528794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a1c8e-04d7-449a-9751-547dbcf8f060 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:14.529172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a1c8e-04d7-449a-9751-547dbcf8f060 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:14.529744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a1c8e-04d7-449a-9751-547dbcf8f060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:14.530478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a1c8e-04d7-449a-9751-547dbcf8f060 None admin] RBAC: Adding query filter params (role.id=9c81eb93ab264328b493f7e8b54e2611, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=0ad87047a3e94b89b28b51d50ed9b5b9) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:14.530854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a1c8e-04d7-449a-9751-547dbcf8f060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:14.532376 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a1c8e-04d7-449a-9751-547dbcf8f060 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:14.538841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 444/900] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:14 2022] GET /identity/v3/role_assignments?user.id=0ad87047a3e94b89b28b51d50ed9b5b9&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=9c81eb93ab264328b493f7e8b54e2611 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:14.552957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdf1c1-6e29-4cbb-ab9b-0d3e2359d7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:14.553748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdf1c1-6e29-4cbb-ab9b-0d3e2359d7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:14.554041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdf1c1-6e29-4cbb-ab9b-0d3e2359d7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:14.554321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdf1c1-6e29-4cbb-ab9b-0d3e2359d7b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:14.555439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdf1c1-6e29-4cbb-ab9b-0d3e2359d7b4 None admin] RBAC: Adding query filter params (interface=public, service_id=f163aee3bc8f48b98b6e85211586d441, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:14.556041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdf1c1-6e29-4cbb-ab9b-0d3e2359d7b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:14.557570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdf1c1-6e29-4cbb-ab9b-0d3e2359d7b4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:14.564470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 457/901] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 17 15:00:14 2022] GET /identity/v3/endpoints?service_id=f163aee3bc8f48b98b6e85211586d441&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:14.570418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a1c8e-04d7-449a-9751-547dbcf8f060 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:14.653692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:14.699404 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a1c8e-04d7-449a-9751-547dbcf8f060 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:14.739446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb69fe-4642-444f-bc01-ed86213f0eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:14.740081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb69fe-4642-444f-bc01-ed86213f0eac None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:14.740365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb69fe-4642-444f-bc01-ed86213f0eac None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:14.740644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb69fe-4642-444f-bc01-ed86213f0eac None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:14.741381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb69fe-4642-444f-bc01-ed86213f0eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:14.743296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb69fe-4642-444f-bc01-ed86213f0eac None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:14.757470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 445/902] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 17 15:00:14 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:00:14.813946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f349c-ba54-4bb5-ab89-5ca17a1d74c1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:14.814220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f349c-ba54-4bb5-ab89-5ca17a1d74c1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:14.814497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f349c-ba54-4bb5-ab89-5ca17a1d74c1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:14.816356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 458/903] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:14.822680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1dcd-af59-43a0-9184-d4ce5cfbedd4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:14.822963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1dcd-af59-43a0-9184-d4ce5cfbedd4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:14.823252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1dcd-af59-43a0-9184-d4ce5cfbedd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:14.846144 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-783d1dcd-af59-43a0-9184-d4ce5cfbedd4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:14.847765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-783d1dcd-af59-43a0-9184-d4ce5cfbedd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:14.934603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 446/904] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:14.960297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f349c-ba54-4bb5-ab89-5ca17a1d74c1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:15.072919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:15.087158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f349c-ba54-4bb5-ab89-5ca17a1d74c1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:15.126313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45756dd9-9426-44c7-b5cf-9c47e73576e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:15.127577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756dd9-9426-44c7-b5cf-9c47e73576e1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:15.128059 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756dd9-9426-44c7-b5cf-9c47e73576e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:15.128522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756dd9-9426-44c7-b5cf-9c47e73576e1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:15.129406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45756dd9-9426-44c7-b5cf-9c47e73576e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:15.131019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45756dd9-9426-44c7-b5cf-9c47e73576e1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-45756dd9-9426-44c7-b5cf-9c47e73576e1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:15.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:15.146108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 15:00:15.146971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:15.150153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 459/905] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Jun 17 15:00:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:15.156473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d1dcd-af59-43a0-9184-d4ce5cfbedd4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:15.221598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:15.266823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d1dcd-af59-43a0-9184-d4ce5cfbedd4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:15.304972 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccf715-e712-445c-abb6-95be4b3620b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:15.306042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccf715-e712-445c-abb6-95be4b3620b2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:15.306518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccf715-e712-445c-abb6-95be4b3620b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:15.307003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccf715-e712-445c-abb6-95be4b3620b2 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:15.307935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccf715-e712-445c-abb6-95be4b3620b2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:15.308434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccf715-e712-445c-abb6-95be4b3620b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:15.310047 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccf715-e712-445c-abb6-95be4b3620b2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:15.316004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 447/906] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:15.322038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45756dd9-9426-44c7-b5cf-9c47e73576e1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:15.430799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45756dd9-9426-44c7-b5cf-9c47e73576e1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:15.479660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf9e5e-425c-4aeb-9a29-4c3a060d9ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:15.480356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9e5e-425c-4aeb-9a29-4c3a060d9ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:15.480636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9e5e-425c-4aeb-9a29-4c3a060d9ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:15.480908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9e5e-425c-4aeb-9a29-4c3a060d9ab1 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:15.481664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf9e5e-425c-4aeb-9a29-4c3a060d9ab1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:15.481966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf9e5e-425c-4aeb-9a29-4c3a060d9ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:15.483382 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf9e5e-425c-4aeb-9a29-4c3a060d9ab1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:15.489608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 460/907] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:15.496096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccf715-e712-445c-abb6-95be4b3620b2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:15.529785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a270c-2fbe-410d-91a3-cc5f59fd894e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:15.530466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a270c-2fbe-410d-91a3-cc5f59fd894e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:15.530742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a270c-2fbe-410d-91a3-cc5f59fd894e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:15.532536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 461/908] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:15.537878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645fb4d-652f-4b9f-a731-74947bac139e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:15.538162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645fb4d-652f-4b9f-a731-74947bac139e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:15.538440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645fb4d-652f-4b9f-a731-74947bac139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:15.557259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a645fb4d-652f-4b9f-a731-74947bac139e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:15.558458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a645fb4d-652f-4b9f-a731-74947bac139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:15.576346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:15.611566 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccf715-e712-445c-abb6-95be4b3620b2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:15.645560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 462/909] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:15.651230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:15.668171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645fb4d-652f-4b9f-a731-74947bac139e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:15.672796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088523db-9bab-4e8a-aa0d-0c7c1dc8760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:15.674576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088523db-9bab-4e8a-aa0d-0c7c1dc8760f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:15.675435 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088523db-9bab-4e8a-aa0d-0c7c1dc8760f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:15.676236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088523db-9bab-4e8a-aa0d-0c7c1dc8760f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:15.678369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088523db-9bab-4e8a-aa0d-0c7c1dc8760f None admin] RBAC: Adding query filter params (interface=public, service_id=0882a95b3c3a43ec99d4d1ebd3638b7e, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:15.679454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088523db-9bab-4e8a-aa0d-0c7c1dc8760f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:15.683292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088523db-9bab-4e8a-aa0d-0c7c1dc8760f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:15.699898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 448/910] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 17 15:00:15 2022] GET /identity/v3/endpoints?service_id=0882a95b3c3a43ec99d4d1ebd3638b7e&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:15.709378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088523db-9bab-4e8a-aa0d-0c7c1dc8760f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:15.781190 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645fb4d-652f-4b9f-a731-74947bac139e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:15.831166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f9c12-ad82-451d-b6af-e65187997a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:15.831881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9c12-ad82-451d-b6af-e65187997a80 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:15.832234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9c12-ad82-451d-b6af-e65187997a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:15.832427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9c12-ad82-451d-b6af-e65187997a80 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:15.833154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f9c12-ad82-451d-b6af-e65187997a80 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:15.834547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f9c12-ad82-451d-b6af-e65187997a80 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:15.835109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088523db-9bab-4e8a-aa0d-0c7c1dc8760f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:15.857607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 463/911] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 15:00:15 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:00:15.906006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215cbf8-398b-43db-ab2a-8d75e4317fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:15.907195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215cbf8-398b-43db-ab2a-8d75e4317fcc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:15.907686 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215cbf8-398b-43db-ab2a-8d75e4317fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:15.908200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215cbf8-398b-43db-ab2a-8d75e4317fcc None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:15.909116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215cbf8-398b-43db-ab2a-8d75e4317fcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:15.910940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215cbf8-398b-43db-ab2a-8d75e4317fcc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:15.923617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 449/912] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 17 15:00:15 2022] GET /identity/v3/services => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:00:16.734855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965b405-c746-4a14-a3b5-5d3e9133a9f3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:16.735798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965b405-c746-4a14-a3b5-5d3e9133a9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:16.736229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965b405-c746-4a14-a3b5-5d3e9133a9f3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:16.738048 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 464/913] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:16.743760 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a9fb7-dbc6-4ea0-b401-c9989568b6a2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:16.744527 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a9fb7-dbc6-4ea0-b401-c9989568b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:16.744966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a9fb7-dbc6-4ea0-b401-c9989568b6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:16.762895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b43a9fb7-dbc6-4ea0-b401-c9989568b6a2 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:16.764325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b43a9fb7-dbc6-4ea0-b401-c9989568b6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:16.811058 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:16.837536 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 450/914] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:16.859978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965b405-c746-4a14-a3b5-5d3e9133a9f3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:16.875003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:16.972796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965b405-c746-4a14-a3b5-5d3e9133a9f3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:17.007718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaea945-bbb1-41b5-8019-eec709f9822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:17.008848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaea945-bbb1-41b5-8019-eec709f9822a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.009166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaea945-bbb1-41b5-8019-eec709f9822a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.009467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaea945-bbb1-41b5-8019-eec709f9822a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.020036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaea945-bbb1-41b5-8019-eec709f9822a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fdaea945-bbb1-41b5-8019-eec709f9822a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:17.028425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:17.029560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:17.030567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 465/915] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 17 15:00:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:17.036122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a9fb7-dbc6-4ea0-b401-c9989568b6a2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:17.149896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a9fb7-dbc6-4ea0-b401-c9989568b6a2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:17.196567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303f3a0-dcbb-4793-8368-c51eec98c99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:17.197221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303f3a0-dcbb-4793-8368-c51eec98c99b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.197513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303f3a0-dcbb-4793-8368-c51eec98c99b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.197790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303f3a0-dcbb-4793-8368-c51eec98c99b None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.198552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303f3a0-dcbb-4793-8368-c51eec98c99b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:17.198860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303f3a0-dcbb-4793-8368-c51eec98c99b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:17.200619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303f3a0-dcbb-4793-8368-c51eec98c99b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:17.205308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa87f59-f1f9-4112-b5aa-cf2a5ed3cd10 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.205873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa87f59-f1f9-4112-b5aa-cf2a5ed3cd10 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.206369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa87f59-f1f9-4112-b5aa-cf2a5ed3cd10 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.209792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 466/917] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:17.210008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 451/917] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 17 15:00:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:17.218328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303f3a0-dcbb-4793-8368-c51eec98c99b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:17.219372 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcdf2f-1d08-48f2-ad7d-0b7aa3dbdb93 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.219860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcdf2f-1d08-48f2-ad7d-0b7aa3dbdb93 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.220327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcdf2f-1d08-48f2-ad7d-0b7aa3dbdb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.240627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f8bcdf2f-1d08-48f2-ad7d-0b7aa3dbdb93 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:17.242969 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f8bcdf2f-1d08-48f2-ad7d-0b7aa3dbdb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:17.269589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:17.316857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:17.322566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 467/918] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:17.338398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303f3a0-dcbb-4793-8368-c51eec98c99b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:17.347949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcdf2f-1d08-48f2-ad7d-0b7aa3dbdb93 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:17.374185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181294d-45d3-47c4-950f-cc1ae042b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:17.374987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181294d-45d3-47c4-950f-cc1ae042b1ec None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.375266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181294d-45d3-47c4-950f-cc1ae042b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.375732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181294d-45d3-47c4-950f-cc1ae042b1ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.387163 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181294d-45d3-47c4-950f-cc1ae042b1ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:17.388836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181294d-45d3-47c4-950f-cc1ae042b1ec None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b181294d-45d3-47c4-950f-cc1ae042b1ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:17.408021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:17.409184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:17.410369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:17.410369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:17.410369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:17.410369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:17.412423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 452/919] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:17.418493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181294d-45d3-47c4-950f-cc1ae042b1ec None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:17.467497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcdf2f-1d08-48f2-ad7d-0b7aa3dbdb93 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:17.506029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4dee5-6d02-475e-9c08-f194adf15c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:17.507277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4dee5-6d02-475e-9c08-f194adf15c5c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.507878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4dee5-6d02-475e-9c08-f194adf15c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.508517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4dee5-6d02-475e-9c08-f194adf15c5c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.509590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4dee5-6d02-475e-9c08-f194adf15c5c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:17.511237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4dee5-6d02-475e-9c08-f194adf15c5c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:17.519146 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d8e4dee5-6d02-475e-9c08-f194adf15c5c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:17.526971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:17.528023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 15:00:17.528864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:17.530528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181294d-45d3-47c4-950f-cc1ae042b1ec None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:17.536707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 468/920] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 15:00:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:17.537863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4dee5-6d02-475e-9c08-f194adf15c5c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:17.568277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128f706-90fc-4272-8a7d-40bfa976c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:17.569332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128f706-90fc-4272-8a7d-40bfa976c485 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.569764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128f706-90fc-4272-8a7d-40bfa976c485 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.570280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128f706-90fc-4272-8a7d-40bfa976c485 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.571169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128f706-90fc-4272-8a7d-40bfa976c485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:17.571882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128f706-90fc-4272-8a7d-40bfa976c485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:17.573559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128f706-90fc-4272-8a7d-40bfa976c485 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:17.587091 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 453/921] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:17.592657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128f706-90fc-4272-8a7d-40bfa976c485 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:17.611126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:17.654906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4dee5-6d02-475e-9c08-f194adf15c5c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:17.692786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aece96-c454-44c3-bc0c-78f9dc803b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:17.693914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aece96-c454-44c3-bc0c-78f9dc803b1b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.694430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aece96-c454-44c3-bc0c-78f9dc803b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.694900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aece96-c454-44c3-bc0c-78f9dc803b1b None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.696203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aece96-c454-44c3-bc0c-78f9dc803b1b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:17.696898 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aece96-c454-44c3-bc0c-78f9dc803b1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:17.698719 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aece96-c454-44c3-bc0c-78f9dc803b1b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:17.707186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128f706-90fc-4272-8a7d-40bfa976c485 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:17.709775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 469/922] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 15:00:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:17.711077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aece96-c454-44c3-bc0c-78f9dc803b1b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:17.751630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeea831-f223-47ee-ac8f-3ff679bb97b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:17.753273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeea831-f223-47ee-ac8f-3ff679bb97b5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.753805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeea831-f223-47ee-ac8f-3ff679bb97b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.754295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeea831-f223-47ee-ac8f-3ff679bb97b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.764046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeea831-f223-47ee-ac8f-3ff679bb97b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:17.766117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeea831-f223-47ee-ac8f-3ff679bb97b5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bfeea831-f223-47ee-ac8f-3ff679bb97b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:17.783292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:17.784272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:17.785200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:17.785200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:17.785200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:17.785200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:17.785200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:17.785200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:17.785200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:17.785200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:17.785200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 15:00:17.785200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:17.788064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 454/923] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 17 15:00:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:17.794726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeea831-f223-47ee-ac8f-3ff679bb97b5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:17.814943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:17.833011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aece96-c454-44c3-bc0c-78f9dc803b1b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:17.871289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:17.884351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0581c0-c3ad-4829-8a99-31a2f5953b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:17.885733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0581c0-c3ad-4829-8a99-31a2f5953b19 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.886249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0581c0-c3ad-4829-8a99-31a2f5953b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.886972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0581c0-c3ad-4829-8a99-31a2f5953b19 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.888823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0581c0-c3ad-4829-8a99-31a2f5953b19 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:17.889398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0581c0-c3ad-4829-8a99-31a2f5953b19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:17.891013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0581c0-c3ad-4829-8a99-31a2f5953b19 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:17.898995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 470/924] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 17 15:00:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:17.909121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0581c0-c3ad-4829-8a99-31a2f5953b19 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:17.932146 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeea831-f223-47ee-ac8f-3ff679bb97b5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:17.981535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083a222-c7aa-404b-943d-48593b419b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:17.982634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083a222-c7aa-404b-943d-48593b419b85 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:17.982925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083a222-c7aa-404b-943d-48593b419b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:17.983207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083a222-c7aa-404b-943d-48593b419b85 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:17.984330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083a222-c7aa-404b-943d-48593b419b85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:17.984645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083a222-c7aa-404b-943d-48593b419b85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:17.986137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083a222-c7aa-404b-943d-48593b419b85 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:18.013258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 455/925] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 17 15:00:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:18.018080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083a222-c7aa-404b-943d-48593b419b85 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:18.031012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0581c0-c3ad-4829-8a99-31a2f5953b19 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:18.069091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aed88d-d8f5-4061-acf9-8ed54ed093c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:18.070106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed88d-d8f5-4061-acf9-8ed54ed093c9 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.070731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed88d-d8f5-4061-acf9-8ed54ed093c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.071186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed88d-d8f5-4061-acf9-8ed54ed093c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.072106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aed88d-d8f5-4061-acf9-8ed54ed093c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:18.073768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aed88d-d8f5-4061-acf9-8ed54ed093c9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:18.105770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 471/926] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 17 15:00:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:00:18.117384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:18.158932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083a222-c7aa-404b-943d-48593b419b85 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:18.162764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c7f9-ad2e-463a-8363-e44763845be1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.163272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c7f9-ad2e-463a-8363-e44763845be1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.163551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c7f9-ad2e-463a-8363-e44763845be1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.165467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 472/927] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:18.170994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca69a71-c42e-4ce7-a469-6c180baf0c78 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.171284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca69a71-c42e-4ce7-a469-6c180baf0c78 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.171548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca69a71-c42e-4ce7-a469-6c180baf0c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.194943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2ca69a71-c42e-4ce7-a469-6c180baf0c78 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:18.196567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2ca69a71-c42e-4ce7-a469-6c180baf0c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:18.219931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df873da-e072-40d9-bca7-79409f969144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:18.221168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df873da-e072-40d9-bca7-79409f969144 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.221590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df873da-e072-40d9-bca7-79409f969144 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.221975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df873da-e072-40d9-bca7-79409f969144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.235503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df873da-e072-40d9-bca7-79409f969144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:18.237361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df873da-e072-40d9-bca7-79409f969144 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4df873da-e072-40d9-bca7-79409f969144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:18.260764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:18.261924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:18.262793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:18.262793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:18.262793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:18.262793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:18.267302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 456/928] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:18.268282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df873da-e072-40d9-bca7-79409f969144 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:18.273349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:18.308462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 473/929] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:18.309913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2d51b-4a11-4f5e-95cd-6cf33eed2190 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.310203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2d51b-4a11-4f5e-95cd-6cf33eed2190 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.310476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2d51b-4a11-4f5e-95cd-6cf33eed2190 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.311956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 474/930] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:18.317993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece39f1c-0330-45b1-b74a-e8542ed202e1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.318290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece39f1c-0330-45b1-b74a-e8542ed202e1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.318573 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece39f1c-0330-45b1-b74a-e8542ed202e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.340479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ece39f1c-0330-45b1-b74a-e8542ed202e1 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:18.341998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ece39f1c-0330-45b1-b74a-e8542ed202e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:18.405473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df873da-e072-40d9-bca7-79409f969144 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:18.423672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:18.445240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 475/931] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:18.445240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece39f1c-0330-45b1-b74a-e8542ed202e1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:18.448521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15328eb5-073e-45fa-a349-e88f472312e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:18.449222 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15328eb5-073e-45fa-a349-e88f472312e4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.449519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15328eb5-073e-45fa-a349-e88f472312e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.449800 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15328eb5-073e-45fa-a349-e88f472312e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.450855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15328eb5-073e-45fa-a349-e88f472312e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:18.451166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15328eb5-073e-45fa-a349-e88f472312e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:18.452566 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15328eb5-073e-45fa-a349-e88f472312e4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:18.466501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 457/932] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:18.467360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15328eb5-073e-45fa-a349-e88f472312e4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:18.562011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece39f1c-0330-45b1-b74a-e8542ed202e1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:18.573364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:18.589014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15328eb5-073e-45fa-a349-e88f472312e4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:18.607667 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94484467-d37b-4b4f-8973-b6bb3ec3f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:18.608460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484467-d37b-4b4f-8973-b6bb3ec3f627 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.608730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484467-d37b-4b4f-8973-b6bb3ec3f627 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.609000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484467-d37b-4b4f-8973-b6bb3ec3f627 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.609700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94484467-d37b-4b4f-8973-b6bb3ec3f627 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:18.611145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94484467-d37b-4b4f-8973-b6bb3ec3f627 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-94484467-d37b-4b4f-8973-b6bb3ec3f627 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:18.625040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:18.626308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:18.627184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 476/933] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:18.627948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94484467-d37b-4b4f-8973-b6bb3ec3f627 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:18.637949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddc655-54c1-416f-91c2-d97c92ef0bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:18.638803 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddc655-54c1-416f-91c2-d97c92ef0bfb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.639141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddc655-54c1-416f-91c2-d97c92ef0bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.639357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddc655-54c1-416f-91c2-d97c92ef0bfb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.640022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddc655-54c1-416f-91c2-d97c92ef0bfb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:18.641640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddc655-54c1-416f-91c2-d97c92ef0bfb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b4ddc655-54c1-416f-91c2-d97c92ef0bfb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:18.656405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:18.657454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:18.658287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 458/934] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Jun 17 15:00:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:18.659101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddc655-54c1-416f-91c2-d97c92ef0bfb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:18.711150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:18.780359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94484467-d37b-4b4f-8973-b6bb3ec3f627 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:18.785981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddc655-54c1-416f-91c2-d97c92ef0bfb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:18.823352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7bc6f-e530-4bd0-a4f5-f055025d35e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:18.824172 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7bc6f-e530-4bd0-a4f5-f055025d35e5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.824408 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7bc6f-e530-4bd0-a4f5-f055025d35e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.824705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7bc6f-e530-4bd0-a4f5-f055025d35e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.827587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154d538-6879-4b05-a3d8-fde339ccbdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:18.830926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d538-6879-4b05-a3d8-fde339ccbdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:18.830926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d538-6879-4b05-a3d8-fde339ccbdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:18.830926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d538-6879-4b05-a3d8-fde339ccbdd0 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:18.830926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154d538-6879-4b05-a3d8-fde339ccbdd0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:18.830926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154d538-6879-4b05-a3d8-fde339ccbdd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:18.832128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154d538-6879-4b05-a3d8-fde339ccbdd0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:18.833256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7bc6f-e530-4bd0-a4f5-f055025d35e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:18.834734 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7bc6f-e530-4bd0-a4f5-f055025d35e5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:18.839137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 459/935] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 17 15:00:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:18.840196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154d538-6879-4b05-a3d8-fde339ccbdd0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e9d7bc6f-e530-4bd0-a4f5-f055025d35e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:18.851958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:18.853107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:18.856400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:18.856400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:18.856400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:18.856400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:18.856400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:18.856400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:18.856400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:18.856400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:18.856400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 477/936] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:18.858192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7bc6f-e530-4bd0-a4f5-f055025d35e5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:18.902758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:18.992743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7bc6f-e530-4bd0-a4f5-f055025d35e5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:19.003970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154d538-6879-4b05-a3d8-fde339ccbdd0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:19.007369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:19.032857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6cdb0-cd9f-4c88-9b71-dbb9857a8a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:19.033640 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6cdb0-cd9f-4c88-9b71-dbb9857a8a7e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:19.033985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6cdb0-cd9f-4c88-9b71-dbb9857a8a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:19.034327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6cdb0-cd9f-4c88-9b71-dbb9857a8a7e None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:19.035028 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6cdb0-cd9f-4c88-9b71-dbb9857a8a7e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:19.035328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6cdb0-cd9f-4c88-9b71-dbb9857a8a7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:19.036681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6cdb0-cd9f-4c88-9b71-dbb9857a8a7e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:19.046627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 478/937] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 17 15:00:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:19.046627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6cdb0-cd9f-4c88-9b71-dbb9857a8a7e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:19.047957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a50778-7d55-46ca-92ed-e43c11910216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:19.048626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a50778-7d55-46ca-92ed-e43c11910216 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:19.048902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a50778-7d55-46ca-92ed-e43c11910216 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:19.049172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a50778-7d55-46ca-92ed-e43c11910216 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:19.050018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a50778-7d55-46ca-92ed-e43c11910216 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:19.050429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a50778-7d55-46ca-92ed-e43c11910216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:19.051801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a50778-7d55-46ca-92ed-e43c11910216 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:19.057310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 460/938] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:19.062400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a50778-7d55-46ca-92ed-e43c11910216 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:19.147216 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:19.154453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6cdb0-cd9f-4c88-9b71-dbb9857a8a7e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:19.167561 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a50778-7d55-46ca-92ed-e43c11910216 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:19.193163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a1071-841b-4de8-a59a-5004a3e1ab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:19.193844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a1071-841b-4de8-a59a-5004a3e1ab4b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:19.194127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a1071-841b-4de8-a59a-5004a3e1ab4b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:19.194443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a1071-841b-4de8-a59a-5004a3e1ab4b None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:19.195962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a1071-841b-4de8-a59a-5004a3e1ab4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:19.196396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a1071-841b-4de8-a59a-5004a3e1ab4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:19.197900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a1071-841b-4de8-a59a-5004a3e1ab4b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:19.205756 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f00b6-f1f0-4287-896d-71bac2072c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:19.206416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f00b6-f1f0-4287-896d-71bac2072c31 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:19.206692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f00b6-f1f0-4287-896d-71bac2072c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:19.206967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f00b6-f1f0-4287-896d-71bac2072c31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:19.207749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f00b6-f1f0-4287-896d-71bac2072c31 None admin] RBAC: Adding query filter params (interface=public, service_id=575c868cf18941d08496ebc7db6856f9, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:19.208057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f00b6-f1f0-4287-896d-71bac2072c31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:19.209447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f00b6-f1f0-4287-896d-71bac2072c31 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:19.210742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 479/939] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:19.224296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 461/940] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 17 15:00:19 2022] GET /identity/v3/endpoints?service_id=575c868cf18941d08496ebc7db6856f9&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:19.224502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a1071-841b-4de8-a59a-5004a3e1ab4b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:19.224597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f00b6-f1f0-4287-896d-71bac2072c31 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:19.258482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:19.344329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f00b6-f1f0-4287-896d-71bac2072c31 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:19.344787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a1071-841b-4de8-a59a-5004a3e1ab4b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:19.381629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd54c31-80af-47ab-a31a-7d38a12e9928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:19.382339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd54c31-80af-47ab-a31a-7d38a12e9928 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:19.382663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd54c31-80af-47ab-a31a-7d38a12e9928 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:19.383036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd54c31-80af-47ab-a31a-7d38a12e9928 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:19.383723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd54c31-80af-47ab-a31a-7d38a12e9928 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:19.384047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd54c31-80af-47ab-a31a-7d38a12e9928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:19.384876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e173ce-c4a7-44b1-aba5-f58f4dd0404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:19.385415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd54c31-80af-47ab-a31a-7d38a12e9928 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:19.386214 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e173ce-c4a7-44b1-aba5-f58f4dd0404c None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:19.386777 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e173ce-c4a7-44b1-aba5-f58f4dd0404c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:19.387250 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e173ce-c4a7-44b1-aba5-f58f4dd0404c None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/0ad87047a3e94b89b28b51d50ed9b5b9/roles/9c81eb93ab264328b493f7e8b54e2611` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:19.389822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e173ce-c4a7-44b1-aba5-f58f4dd0404c None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=0ad87047a3e94b89b28b51d50ed9b5b9, role_id=9c81eb93ab264328b493f7e8b54e2611)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:19.390550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 480/941] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:19.391358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd54c31-80af-47ab-a31a-7d38a12e9928 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:19.391945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e173ce-c4a7-44b1-aba5-f58f4dd0404c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:19.414999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 462/942] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 15:00:19 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/0ad87047a3e94b89b28b51d50ed9b5b9/roles/9c81eb93ab264328b493f7e8b54e2611 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:00:19.416512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e173ce-c4a7-44b1-aba5-f58f4dd0404c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:19.427334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:19.550204 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd54c31-80af-47ab-a31a-7d38a12e9928 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:19.587611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:19.604387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529c620-812c-478c-a2cf-51762600d893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:19.604387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529c620-812c-478c-a2cf-51762600d893 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:19.606109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e173ce-c4a7-44b1-aba5-f58f4dd0404c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:19.607111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529c620-812c-478c-a2cf-51762600d893 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:19.607111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529c620-812c-478c-a2cf-51762600d893 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:19.607111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529c620-812c-478c-a2cf-51762600d893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:19.607111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529c620-812c-478c-a2cf-51762600d893 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:19.613013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 481/943] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 17 15:00:19 2022] GET /identity/v3/services => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:00:19.653330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c3239-42ba-4322-8a15-3fc10619e5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:19.654028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c3239-42ba-4322-8a15-3fc10619e5fd None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:19.654309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c3239-42ba-4322-8a15-3fc10619e5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:19.654582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c3239-42ba-4322-8a15-3fc10619e5fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:19.655389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c3239-42ba-4322-8a15-3fc10619e5fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:19.656841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c3239-42ba-4322-8a15-3fc10619e5fd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:19.685551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 463/944] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 17 15:00:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:20.438552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde772e-4201-45e3-ba4f-822a6f2ead90 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:20.439089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde772e-4201-45e3-ba4f-822a6f2ead90 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:20.439497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde772e-4201-45e3-ba4f-822a6f2ead90 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:20.442288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 482/945] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:20.451595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cddfc4-329b-4aa5-94eb-5990e649c8fb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:20.452052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cddfc4-329b-4aa5-94eb-5990e649c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:20.452535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cddfc4-329b-4aa5-94eb-5990e649c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:20.480875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-31cddfc4-329b-4aa5-94eb-5990e649c8fb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:20.482793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-31cddfc4-329b-4aa5-94eb-5990e649c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:20.609509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 464/946] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:20.650830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde772e-4201-45e3-ba4f-822a6f2ead90 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:20.797863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:20.810949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde772e-4201-45e3-ba4f-822a6f2ead90 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:20.847932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:20.848620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:20.848901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:20.849175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:20.849944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:20.851478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:20.852920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: WARNING keystone.server.flask.common [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 17 15:00:20.872239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.sql.core [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 15:00:20.872239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 15:00:20.872239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [parameters: {'id': '615ee56fcea04a03a3f3344591fd9d6d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 15:00:20.872239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80333) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 615ee56fcea04a03a3f3344591fd9d6d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 615ee56fcea04a03a3f3344591fd9d6d. Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 15:00:20.880295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 17 15:00:20.881109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application yield resource Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise self.value Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application session.commit() Jun 17 15:00:20.882131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.flush() Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application compat.raise_( Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 15:00:20.883075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 15:00:20.884121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 15:00:20.884921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [parameters: {'id': '615ee56fcea04a03a3f3344591fd9d6d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:20.887451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:20.889403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:20.891500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:20.891500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 17 15:00:20.891500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 17 15:00:20.891500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:20.891500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:20.891500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 17 15:00:20.891500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 17 15:00:20.891500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 615ee56fcea04a03a3f3344591fd9d6d. Jun 17 15:00:20.891500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:20.891500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 483/947] 10.222.0.45 () {60 vars in 1140 bytes} [Fri Jun 17 15:00:20 2022] POST /identity/v3/projects => generated 262 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:20.897994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cddfc4-329b-4aa5-94eb-5990e649c8fb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:21.001894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:21.046590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cddfc4-329b-4aa5-94eb-5990e649c8fb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:21.108119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999b050-b05f-4448-8054-25b85cde91eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:21.109539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999b050-b05f-4448-8054-25b85cde91eb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:21.110006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999b050-b05f-4448-8054-25b85cde91eb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:21.110492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999b050-b05f-4448-8054-25b85cde91eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:21.122998 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999b050-b05f-4448-8054-25b85cde91eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:21.125719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999b050-b05f-4448-8054-25b85cde91eb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3999b050-b05f-4448-8054-25b85cde91eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:21.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:21.152092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:21.153245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:21.153245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:21.153245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:21.153245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:21.153245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:21.153245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:21.153245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:21.153245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:21.154141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 465/948] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:21.160441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:21.265154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c7e6b-1f38-4f35-8562-8c4a7f080c32 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:21.307492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261608f2-2ead-4ae0-8818-9bb6522912b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:21.308067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261608f2-2ead-4ae0-8818-9bb6522912b7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:21.308364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261608f2-2ead-4ae0-8818-9bb6522912b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:21.308627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261608f2-2ead-4ae0-8818-9bb6522912b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:21.309449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261608f2-2ead-4ae0-8818-9bb6522912b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:21.309759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261608f2-2ead-4ae0-8818-9bb6522912b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:21.311402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261608f2-2ead-4ae0-8818-9bb6522912b7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:21.326646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:21.333029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 484/949] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 15:00:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:21.660382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd62706-6895-48d9-a751-a6f7f391bdd1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:21.660892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd62706-6895-48d9-a751-a6f7f391bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:21.661087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd62706-6895-48d9-a751-a6f7f391bdd1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:21.662857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 466/950] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:21.668656 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef3a8b-1baa-48e3-b81d-ef954917f29b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:21.669099 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef3a8b-1baa-48e3-b81d-ef954917f29b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:21.669439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef3a8b-1baa-48e3-b81d-ef954917f29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:21.688418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-29ef3a8b-1baa-48e3-b81d-ef954917f29b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:21.690108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-29ef3a8b-1baa-48e3-b81d-ef954917f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:21.762746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 485/951] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:21.788134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd62706-6895-48d9-a751-a6f7f391bdd1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:21.907542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd62706-6895-48d9-a751-a6f7f391bdd1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:21.928436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18634d35-ac80-470a-b8c2-07d2f87daff5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:21.929059 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18634d35-ac80-470a-b8c2-07d2f87daff5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:21.929795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18634d35-ac80-470a-b8c2-07d2f87daff5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:21.931865 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 486/952] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:21.939152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482ca55-c74a-443e-8bcc-83e06ec8469b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:21.939895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482ca55-c74a-443e-8bcc-83e06ec8469b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:21.940612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482ca55-c74a-443e-8bcc-83e06ec8469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:21.951074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae4cb7-4a82-4679-b09b-bba9620454ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:21.952062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4cb7-4a82-4679-b09b-bba9620454ee None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:21.952348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4cb7-4a82-4679-b09b-bba9620454ee None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:21.952628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4cb7-4a82-4679-b09b-bba9620454ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:21.961577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:21.966104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1482ca55-c74a-443e-8bcc-83e06ec8469b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:21.967642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1482ca55-c74a-443e-8bcc-83e06ec8469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:21.969629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae4cb7-4a82-4679-b09b-bba9620454ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3dae4cb7-4a82-4679-b09b-bba9620454ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:21.977978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:21.979088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:21.979977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 467/953] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 17 15:00:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:21.985465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae4cb7-4a82-4679-b09b-bba9620454ee None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.061240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 487/954] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:22.061240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2587529-524d-4cb5-900b-5183f398d7a6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.061240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2587529-524d-4cb5-900b-5183f398d7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.061240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2587529-524d-4cb5-900b-5183f398d7a6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.061240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 488/955] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:22.061699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace58c-feda-4941-b69e-1122d289cee0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.061778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace58c-feda-4941-b69e-1122d289cee0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.062054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace58c-feda-4941-b69e-1122d289cee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.091782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8eace58c-feda-4941-b69e-1122d289cee0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:22.093588 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8eace58c-feda-4941-b69e-1122d289cee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:22.101732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae4cb7-4a82-4679-b09b-bba9620454ee None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:22.139335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc694c44-79eb-4ad5-8ae1-c5f833806223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:22.140164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc694c44-79eb-4ad5-8ae1-c5f833806223 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.140730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc694c44-79eb-4ad5-8ae1-c5f833806223 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.141030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc694c44-79eb-4ad5-8ae1-c5f833806223 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.141978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc694c44-79eb-4ad5-8ae1-c5f833806223 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:22.142345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc694c44-79eb-4ad5-8ae1-c5f833806223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:22.143767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc694c44-79eb-4ad5-8ae1-c5f833806223 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:22.157132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 468/956] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 17 15:00:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:22.158067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc694c44-79eb-4ad5-8ae1-c5f833806223 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.171943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:22.189386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 489/957] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:22.189386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace58c-feda-4941-b69e-1122d289cee0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.240350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:22.302847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace58c-feda-4941-b69e-1122d289cee0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:22.307790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc694c44-79eb-4ad5-8ae1-c5f833806223 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:22.342152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af2c5b-0803-46d5-9261-6170d22198f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:22.343381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af2c5b-0803-46d5-9261-6170d22198f9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.343811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af2c5b-0803-46d5-9261-6170d22198f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.344222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af2c5b-0803-46d5-9261-6170d22198f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.350274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013af9a3-f533-4738-9766-d7507ccfbea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:22.351104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af9a3-f533-4738-9766-d7507ccfbea3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.351624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af9a3-f533-4738-9766-d7507ccfbea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.351818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af9a3-f533-4738-9766-d7507ccfbea3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.352479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013af9a3-f533-4738-9766-d7507ccfbea3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:22.353906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013af9a3-f533-4738-9766-d7507ccfbea3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:22.358073 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af2c5b-0803-46d5-9261-6170d22198f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:22.359383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af2c5b-0803-46d5-9261-6170d22198f9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-013af9a3-f533-4738-9766-d7507ccfbea3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:22.369357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:22.370574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:22.371436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 469/958] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:22.372253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013af9a3-f533-4738-9766-d7507ccfbea3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a5af2c5b-0803-46d5-9261-6170d22198f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:22.386013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:22.387025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:22.388003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:22.388003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:22.388003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:22.388003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:22.388003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 490/959] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:22.388289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af2c5b-0803-46d5-9261-6170d22198f9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.438243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:22.486624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013af9a3-f533-4738-9766-d7507ccfbea3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:22.503417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af2c5b-0803-46d5-9261-6170d22198f9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:22.509332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:22.530104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef686ff7-69a4-4721-bb44-10645470d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:22.530935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef686ff7-69a4-4721-bb44-10645470d3af None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.531220 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef686ff7-69a4-4721-bb44-10645470d3af None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.531499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef686ff7-69a4-4721-bb44-10645470d3af None admin] PATH_INFO: `/v3/services/compute` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.532176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef686ff7-69a4-4721-bb44-10645470d3af None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:22.536432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef686ff7-69a4-4721-bb44-10645470d3af None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:22.542112 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e129d8d-9685-4603-ab68-5fa0f58c5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:22.542791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e129d8d-9685-4603-ab68-5fa0f58c5120 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.543070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e129d8d-9685-4603-ab68-5fa0f58c5120 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.543343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e129d8d-9685-4603-ab68-5fa0f58c5120 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.544079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e129d8d-9685-4603-ab68-5fa0f58c5120 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:22.544400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e129d8d-9685-4603-ab68-5fa0f58c5120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:22.545889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e129d8d-9685-4603-ab68-5fa0f58c5120 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ef686ff7-69a4-4721-bb44-10645470d3af None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:22.550032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:22.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:22.558325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 470/960] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:22.559346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 491/961] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 17 15:00:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:22.559428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef686ff7-69a4-4721-bb44-10645470d3af None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.559506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e129d8d-9685-4603-ab68-5fa0f58c5120 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.667043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e129d8d-9685-4603-ab68-5fa0f58c5120 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:22.675851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:22.680114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef686ff7-69a4-4721-bb44-10645470d3af None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:22.708017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e266e-9f84-4e76-a97a-6180bc2e1202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:22.708771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e266e-9f84-4e76-a97a-6180bc2e1202 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.709054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e266e-9f84-4e76-a97a-6180bc2e1202 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.709358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e266e-9f84-4e76-a97a-6180bc2e1202 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.710066 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e266e-9f84-4e76-a97a-6180bc2e1202 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:22.710368 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e266e-9f84-4e76-a97a-6180bc2e1202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:22.711935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e266e-9f84-4e76-a97a-6180bc2e1202 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:22.717007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8459-85fc-4d6f-b0ff-08cd6f6f3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:22.717702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 492/962] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 15:00:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:22.718464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e266e-9f84-4e76-a97a-6180bc2e1202 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.722450 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8459-85fc-4d6f-b0ff-08cd6f6f3d4b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.722747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8459-85fc-4d6f-b0ff-08cd6f6f3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.723034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8459-85fc-4d6f-b0ff-08cd6f6f3d4b None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.723793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a8459-85fc-4d6f-b0ff-08cd6f6f3d4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:22.724114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a8459-85fc-4d6f-b0ff-08cd6f6f3d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:22.725571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a8459-85fc-4d6f-b0ff-08cd6f6f3d4b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:22.740202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 471/963] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:22.741050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8459-85fc-4d6f-b0ff-08cd6f6f3d4b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.795874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:22.839855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e266e-9f84-4e76-a97a-6180bc2e1202 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:22.852190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8459-85fc-4d6f-b0ff-08cd6f6f3d4b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:22.879221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb514eb-fd84-4515-91f8-9f41d7a13adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:22.879926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb514eb-fd84-4515-91f8-9f41d7a13adc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.880201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb514eb-fd84-4515-91f8-9f41d7a13adc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.880470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb514eb-fd84-4515-91f8-9f41d7a13adc None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.881184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb514eb-fd84-4515-91f8-9f41d7a13adc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:22.881639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb514eb-fd84-4515-91f8-9f41d7a13adc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:22.883146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb514eb-fd84-4515-91f8-9f41d7a13adc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:22.888117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 493/964] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 17 15:00:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:22.888886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb514eb-fd84-4515-91f8-9f41d7a13adc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.894051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87ca97-c7f6-43b4-b60a-2b8a0ff951a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:22.895008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ca97-c7f6-43b4-b60a-2b8a0ff951a9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:22.895446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ca97-c7f6-43b4-b60a-2b8a0ff951a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:22.895858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ca97-c7f6-43b4-b60a-2b8a0ff951a9 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:22.896777 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ca97-c7f6-43b4-b60a-2b8a0ff951a9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:22.897099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ca97-c7f6-43b4-b60a-2b8a0ff951a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:22.899286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ca97-c7f6-43b4-b60a-2b8a0ff951a9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:22.913243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 472/965] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 15:00:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:22.913243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87ca97-c7f6-43b4-b60a-2b8a0ff951a9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:22.941735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:23.026331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb514eb-fd84-4515-91f8-9f41d7a13adc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:23.050643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87ca97-c7f6-43b4-b60a-2b8a0ff951a9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:23.062782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:23.071491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1f52d-ee69-41a3-968e-017cce76e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:23.072583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f52d-ee69-41a3-968e-017cce76e649 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:23.072860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f52d-ee69-41a3-968e-017cce76e649 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:23.073160 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f52d-ee69-41a3-968e-017cce76e649 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:23.084942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1f52d-ee69-41a3-968e-017cce76e649 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:23.086844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1f52d-ee69-41a3-968e-017cce76e649 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:23.096572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f153b-ce6b-4769-a5ae-017eb3fc3955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:23.097586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f153b-ce6b-4769-a5ae-017eb3fc3955 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:23.097862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f153b-ce6b-4769-a5ae-017eb3fc3955 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:23.098136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f153b-ce6b-4769-a5ae-017eb3fc3955 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:23.098885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f153b-ce6b-4769-a5ae-017eb3fc3955 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:23.100379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f153b-ce6b-4769-a5ae-017eb3fc3955 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c1d1f52d-ee69-41a3-968e-017cce76e649 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:23.107176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:23.108192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:23.109326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 494/966] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 17 15:00:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:23.116665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1f52d-ee69-41a3-968e-017cce76e649 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:23.123897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 473/967] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 17 15:00:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:23.240640 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:23.248742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1f52d-ee69-41a3-968e-017cce76e649 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:23.295343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506bdcf-d102-44a0-8907-111aa9cc850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:23.296268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506bdcf-d102-44a0-8907-111aa9cc850e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:23.296720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506bdcf-d102-44a0-8907-111aa9cc850e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:23.297145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506bdcf-d102-44a0-8907-111aa9cc850e None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:23.298179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506bdcf-d102-44a0-8907-111aa9cc850e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:23.298659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506bdcf-d102-44a0-8907-111aa9cc850e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:23.300253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506bdcf-d102-44a0-8907-111aa9cc850e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:23.322853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 495/968] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 17 15:00:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:23.326914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f153b-ce6b-4769-a5ae-017eb3fc3955 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:23.435305 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f153b-ce6b-4769-a5ae-017eb3fc3955 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:23.473726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66824c-2b40-4dac-9138-54e19d2e895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:23.474787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66824c-2b40-4dac-9138-54e19d2e895b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:23.475265 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66824c-2b40-4dac-9138-54e19d2e895b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:23.475755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66824c-2b40-4dac-9138-54e19d2e895b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:23.518052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:23.554326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66824c-2b40-4dac-9138-54e19d2e895b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:23.556235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66824c-2b40-4dac-9138-54e19d2e895b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:23.597671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918ab1e-0670-4786-bbee-6d9304ac81d1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:23.598301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918ab1e-0670-4786-bbee-6d9304ac81d1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:23.598786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918ab1e-0670-4786-bbee-6d9304ac81d1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:23.600608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 496/969] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:23.610163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dd3ab-37fb-441c-b00e-4bb60bc9a2ea None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:23.610813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dd3ab-37fb-441c-b00e-4bb60bc9a2ea None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:23.611284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dd3ab-37fb-441c-b00e-4bb60bc9a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:23.634933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0f8dd3ab-37fb-441c-b00e-4bb60bc9a2ea None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:23.636572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0f8dd3ab-37fb-441c-b00e-4bb60bc9a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:23.668026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 474/970] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:23 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 15:00:23.676513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66824c-2b40-4dac-9138-54e19d2e895b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:23.717841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 497/971] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:23.746294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dd3ab-37fb-441c-b00e-4bb60bc9a2ea None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:23.749477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:23.800741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66824c-2b40-4dac-9138-54e19d2e895b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:23.848081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:23.849869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495acb1d-78df-4f8b-9179-ddee73877e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:23.851005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495acb1d-78df-4f8b-9179-ddee73877e09 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:23.852245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495acb1d-78df-4f8b-9179-ddee73877e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:23.852705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495acb1d-78df-4f8b-9179-ddee73877e09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:23.872925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495acb1d-78df-4f8b-9179-ddee73877e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:23.875426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495acb1d-78df-4f8b-9179-ddee73877e09 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:23.877476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dd3ab-37fb-441c-b00e-4bb60bc9a2ea None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-495acb1d-78df-4f8b-9179-ddee73877e09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:23.900814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:23.901999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:23.903102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:23.903102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:23.903102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:23.903102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:23.905610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 475/972] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:23.914341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495acb1d-78df-4f8b-9179-ddee73877e09 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:23.921593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9251044-b334-4d20-94ff-1cd6e0511aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:23.922668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9251044-b334-4d20-94ff-1cd6e0511aa2 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:23.923192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9251044-b334-4d20-94ff-1cd6e0511aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:23.923686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9251044-b334-4d20-94ff-1cd6e0511aa2 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:23.924647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9251044-b334-4d20-94ff-1cd6e0511aa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:23.926430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9251044-b334-4d20-94ff-1cd6e0511aa2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:23.942247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.sql.core [None req-b9251044-b334-4d20-94ff-1cd6e0511aa2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 15:00:23.942247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 15:00:23.942247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [parameters: {'user_id': '562fbe50a84e46c38bf6aeede3033630', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 15:00:23.942247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80333) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b9251044-b334-4d20-94ff-1cd6e0511aa2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Jun 17 15:00:23.951534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 15:00:23.952525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application yield resource Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise self.value Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application session.commit() Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 15:00:23.953515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.flush() Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application compat.raise_( Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 15:00:23.954416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 15:00:23.955319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 15:00:23.956178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [parameters: {'user_id': '562fbe50a84e46c38bf6aeede3033630', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:23.956992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 17 15:00:23.959530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 17 15:00:23.961608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 17 15:00:23.961608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 17 15:00:23.961608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 15:00:23.961608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 15:00:23.961608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 15:00:23.961608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:23.967369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 498/973] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Jun 17 15:00:23 2022] POST /identity/v3/users => generated 160 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:23.969295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9251044-b334-4d20-94ff-1cd6e0511aa2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:24.053013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495acb1d-78df-4f8b-9179-ddee73877e09 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:24.071198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:24.090070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bad50-dea8-4dc8-8aad-055f44ccdd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:24.090742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bad50-dea8-4dc8-8aad-055f44ccdd1d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:24.091020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bad50-dea8-4dc8-8aad-055f44ccdd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:24.091295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bad50-dea8-4dc8-8aad-055f44ccdd1d None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:24.092012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bad50-dea8-4dc8-8aad-055f44ccdd1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:24.092316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bad50-dea8-4dc8-8aad-055f44ccdd1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:24.093783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bad50-dea8-4dc8-8aad-055f44ccdd1d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:24.103814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9251044-b334-4d20-94ff-1cd6e0511aa2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:24.106029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 476/974] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:24.111611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bad50-dea8-4dc8-8aad-055f44ccdd1d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:24.147554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e69b41-114a-421d-96b3-f3c1f2bee224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:24.148848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e69b41-114a-421d-96b3-f3c1f2bee224 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:24.149345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e69b41-114a-421d-96b3-f3c1f2bee224 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:24.149759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e69b41-114a-421d-96b3-f3c1f2bee224 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:24.160178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e69b41-114a-421d-96b3-f3c1f2bee224 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:24.163587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e69b41-114a-421d-96b3-f3c1f2bee224 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:24.169783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f5e69b41-114a-421d-96b3-f3c1f2bee224 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:24.184142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:24.185165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:24.186166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:24.186166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:24.186166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:24.186166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:24.186166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:24.186166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:24.186166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:24.186166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:24.186166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 15:00:24.186166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:24.190559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 499/975] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:00:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:24.191989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e69b41-114a-421d-96b3-f3c1f2bee224 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:24.248251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bad50-dea8-4dc8-8aad-055f44ccdd1d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:24.295497 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1918f6-1a22-45cd-996b-f66424c1bb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:24.296578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1918f6-1a22-45cd-996b-f66424c1bb8b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:24.297035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1918f6-1a22-45cd-996b-f66424c1bb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:24.297483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1918f6-1a22-45cd-996b-f66424c1bb8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:24.307921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1918f6-1a22-45cd-996b-f66424c1bb8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:24.310278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1918f6-1a22-45cd-996b-f66424c1bb8b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:24.326877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e69b41-114a-421d-96b3-f3c1f2bee224 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-da1918f6-1a22-45cd-996b-f66424c1bb8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:24.331553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:24.332675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:24.333807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:24.333807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:24.333807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:24.333807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:24.333807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:24.333807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:24.333807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:24.333807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:24.341758 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 477/976] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:24.345085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1918f6-1a22-45cd-996b-f66424c1bb8b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:24.381980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc245-a059-4240-b118-956cc9394a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:24.382794 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc245-a059-4240-b118-956cc9394a51 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:24.383714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc245-a059-4240-b118-956cc9394a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:24.384053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc245-a059-4240-b118-956cc9394a51 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:24.385674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bc245-a059-4240-b118-956cc9394a51 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:24.386223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bc245-a059-4240-b118-956cc9394a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:24.389608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bc245-a059-4240-b118-956cc9394a51 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:24.390485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:24.437548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 500/977] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 17 15:00:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:24.470457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1918f6-1a22-45cd-996b-f66424c1bb8b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:24.512584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593ceb-c97d-4f73-8223-32b1a2fc3511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:24.513559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593ceb-c97d-4f73-8223-32b1a2fc3511 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:24.513992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593ceb-c97d-4f73-8223-32b1a2fc3511 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:24.514418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593ceb-c97d-4f73-8223-32b1a2fc3511 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:24.515413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593ceb-c97d-4f73-8223-32b1a2fc3511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:24.515878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593ceb-c97d-4f73-8223-32b1a2fc3511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:24.517553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593ceb-c97d-4f73-8223-32b1a2fc3511 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:24.537378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 478/978] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:24.539416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc245-a059-4240-b118-956cc9394a51 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:24.610682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:24.669708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc245-a059-4240-b118-956cc9394a51 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:24.712008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab4936-89f5-4aa2-9d79-a88473f17052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:24.713084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4936-89f5-4aa2-9d79-a88473f17052 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:24.713793 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4936-89f5-4aa2-9d79-a88473f17052 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:24.714235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4936-89f5-4aa2-9d79-a88473f17052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:24.715786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab4936-89f5-4aa2-9d79-a88473f17052 None admin] RBAC: Adding query filter params (role.id=9c81eb93ab264328b493f7e8b54e2611, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=0ad87047a3e94b89b28b51d50ed9b5b9) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:24.716275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab4936-89f5-4aa2-9d79-a88473f17052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:24.718859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab4936-89f5-4aa2-9d79-a88473f17052 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:24.726832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 501/979] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:24 2022] GET /identity/v3/role_assignments?user.id=0ad87047a3e94b89b28b51d50ed9b5b9&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=9c81eb93ab264328b493f7e8b54e2611 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:25.167659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b88bc-374f-4aa6-a850-028d7ac8d085 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:25.168208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b88bc-374f-4aa6-a850-028d7ac8d085 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:25.168208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b88bc-374f-4aa6-a850-028d7ac8d085 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:25.169569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 479/980] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:25.175131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eaef7-46ad-4bad-9d56-e50825798f0d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:25.175379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eaef7-46ad-4bad-9d56-e50825798f0d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:25.175689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eaef7-46ad-4bad-9d56-e50825798f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:25.193487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e39eaef7-46ad-4bad-9d56-e50825798f0d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:25.195256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e39eaef7-46ad-4bad-9d56-e50825798f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:25.273946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 502/981] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:25.296530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b88bc-374f-4aa6-a850-028d7ac8d085 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:25.404628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:25.414321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b88bc-374f-4aa6-a850-028d7ac8d085 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:25.452097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3547b-b1f6-4f96-9609-92d38cd790f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:25.452690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3547b-b1f6-4f96-9609-92d38cd790f1 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:25.452820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881175ce-66b3-4cb4-8ba2-6cba8de96476 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:25.452986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3547b-b1f6-4f96-9609-92d38cd790f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:25.453084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881175ce-66b3-4cb4-8ba2-6cba8de96476 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:25.453277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3547b-b1f6-4f96-9609-92d38cd790f1 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:25.453376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881175ce-66b3-4cb4-8ba2-6cba8de96476 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:25.454004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3547b-b1f6-4f96-9609-92d38cd790f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:25.454779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 503/982] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:25.455373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3547b-b1f6-4f96-9609-92d38cd790f1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:25.460500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c161cb6-1c96-4f4b-ba07-b7be5f4d903a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:25.460851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c161cb6-1c96-4f4b-ba07-b7be5f4d903a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:25.461344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c161cb6-1c96-4f4b-ba07-b7be5f4d903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:25.471693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 480/983] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 15:00:25 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:25.481529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5c161cb6-1c96-4f4b-ba07-b7be5f4d903a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:25.482822 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5c161cb6-1c96-4f4b-ba07-b7be5f4d903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:25.537634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:25.572331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 504/984] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:25.595909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3547b-b1f6-4f96-9609-92d38cd790f1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:25.709439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3547b-b1f6-4f96-9609-92d38cd790f1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:25.746482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead7fb0-280c-46b7-836e-48e98a091fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:25.747294 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead7fb0-280c-46b7-836e-48e98a091fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:25.747555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead7fb0-280c-46b7-836e-48e98a091fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:25.747865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead7fb0-280c-46b7-836e-48e98a091fc1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:25.748507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead7fb0-280c-46b7-836e-48e98a091fc1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:25.749900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead7fb0-280c-46b7-836e-48e98a091fc1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1ead7fb0-280c-46b7-836e-48e98a091fc1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:25.762196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:25.763223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:25.764068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 481/985] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:25.769714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c161cb6-1c96-4f4b-ba07-b7be5f4d903a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:25.882854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c161cb6-1c96-4f4b-ba07-b7be5f4d903a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:25.918448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1ac4b-09ad-4dc2-9680-6c579650660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:25.919145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1ac4b-09ad-4dc2-9680-6c579650660d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:25.919421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1ac4b-09ad-4dc2-9680-6c579650660d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:25.919695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1ac4b-09ad-4dc2-9680-6c579650660d None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:25.920405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1ac4b-09ad-4dc2-9680-6c579650660d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:25.920711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1ac4b-09ad-4dc2-9680-6c579650660d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:25.922123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1ac4b-09ad-4dc2-9680-6c579650660d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:25.927770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 505/986] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 17 15:00:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:25.933473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead7fb0-280c-46b7-836e-48e98a091fc1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:25.958987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:26.049338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead7fb0-280c-46b7-836e-48e98a091fc1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:26.096474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652a2a4-d994-4ead-afea-b079af66f548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:26.097186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652a2a4-d994-4ead-afea-b079af66f548 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:26.097494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652a2a4-d994-4ead-afea-b079af66f548 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:26.097775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652a2a4-d994-4ead-afea-b079af66f548 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:26.098480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652a2a4-d994-4ead-afea-b079af66f548 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:26.098888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652a2a4-d994-4ead-afea-b079af66f548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:26.101019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652a2a4-d994-4ead-afea-b079af66f548 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:26.108177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 482/987] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 17 15:00:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:26.115819 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1ac4b-09ad-4dc2-9680-6c579650660d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:26.160552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:26.230179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1ac4b-09ad-4dc2-9680-6c579650660d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:26.265411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324cc8a-239a-47df-9c78-82b1ce2d4536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:26.266074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324cc8a-239a-47df-9c78-82b1ce2d4536 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:26.266358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324cc8a-239a-47df-9c78-82b1ce2d4536 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:26.266635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324cc8a-239a-47df-9c78-82b1ce2d4536 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:26.267428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324cc8a-239a-47df-9c78-82b1ce2d4536 None admin] RBAC: Adding query filter params (interface=admin, service_id=575c868cf18941d08496ebc7db6856f9, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:26.267750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324cc8a-239a-47df-9c78-82b1ce2d4536 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:26.269124 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324cc8a-239a-47df-9c78-82b1ce2d4536 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:26.275116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 506/988] 10.222.0.45 () {56 vars in 1249 bytes} [Fri Jun 17 15:00:26 2022] GET /identity/v3/endpoints?service_id=575c868cf18941d08496ebc7db6856f9&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:26.280855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652a2a4-d994-4ead-afea-b079af66f548 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:26.370186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:26.388310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652a2a4-d994-4ead-afea-b079af66f548 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:26.425172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e835c-e389-48ac-8497-15bd36e5f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:26.425873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e835c-e389-48ac-8497-15bd36e5f262 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:26.426156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e835c-e389-48ac-8497-15bd36e5f262 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:26.426432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e835c-e389-48ac-8497-15bd36e5f262 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:26.427126 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e835c-e389-48ac-8497-15bd36e5f262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:26.428506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e835c-e389-48ac-8497-15bd36e5f262 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:26.435573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 483/989] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 17 15:00:26 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:00:26.926613 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcab76-0733-4221-b723-a2bb482ac19e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:26.927142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcab76-0733-4221-b723-a2bb482ac19e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:26.927142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcab76-0733-4221-b723-a2bb482ac19e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:26.928688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 507/990] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:26.934011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8c4e-d76e-4fe4-a3d8-4b9aae4b2854 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:26.934288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8c4e-d76e-4fe4-a3d8-4b9aae4b2854 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:26.934559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8c4e-d76e-4fe4-a3d8-4b9aae4b2854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:26.952237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b74a8c4e-d76e-4fe4-a3d8-4b9aae4b2854 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:26.953477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b74a8c4e-d76e-4fe4-a3d8-4b9aae4b2854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:27.023806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 484/991] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:27.046278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcab76-0733-4221-b723-a2bb482ac19e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:27.156166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcab76-0733-4221-b723-a2bb482ac19e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:27.164050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:27.192806 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa24d26-2b21-430a-9ea1-1231a57be9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:27.193649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa24d26-2b21-430a-9ea1-1231a57be9ff None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:27.193929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa24d26-2b21-430a-9ea1-1231a57be9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:27.194199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa24d26-2b21-430a-9ea1-1231a57be9ff None admin] PATH_INFO: `/v3/services/image` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:27.194901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa24d26-2b21-430a-9ea1-1231a57be9ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:27.196402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa24d26-2b21-430a-9ea1-1231a57be9ff None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ffa24d26-2b21-430a-9ea1-1231a57be9ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:27.209078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:27.210509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 15:00:27.212737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:27.219203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 508/992] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Jun 17 15:00:27 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:27.219458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8c4e-d76e-4fe4-a3d8-4b9aae4b2854 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:27.300441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:27.325959 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8c4e-d76e-4fe4-a3d8-4b9aae4b2854 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:27.362480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59373a4-9d25-4ff8-89cc-d2f982e61ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:27.363157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59373a4-9d25-4ff8-89cc-d2f982e61ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:27.363437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59373a4-9d25-4ff8-89cc-d2f982e61ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:27.363713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59373a4-9d25-4ff8-89cc-d2f982e61ae1 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:27.364425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59373a4-9d25-4ff8-89cc-d2f982e61ae1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:27.364741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59373a4-9d25-4ff8-89cc-d2f982e61ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:27.366158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59373a4-9d25-4ff8-89cc-d2f982e61ae1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:27.371801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 485/993] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:27.377359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa24d26-2b21-430a-9ea1-1231a57be9ff None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:27.482265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa24d26-2b21-430a-9ea1-1231a57be9ff None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:27.517336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7051fd-8b9c-4fa7-ba7e-a713ac1d1dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:27.518032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7051fd-8b9c-4fa7-ba7e-a713ac1d1dec None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:27.518315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7051fd-8b9c-4fa7-ba7e-a713ac1d1dec None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:27.518572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7051fd-8b9c-4fa7-ba7e-a713ac1d1dec None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:27.519276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7051fd-8b9c-4fa7-ba7e-a713ac1d1dec None admin] RBAC: Adding query filter params (type=image) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:27.519582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7051fd-8b9c-4fa7-ba7e-a713ac1d1dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:27.520958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7051fd-8b9c-4fa7-ba7e-a713ac1d1dec None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:27.533506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 509/994] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:27.733471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb3a0b-b6e8-4596-89da-eeae3fe6536c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:27.733671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb3a0b-b6e8-4596-89da-eeae3fe6536c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:27.733963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb3a0b-b6e8-4596-89da-eeae3fe6536c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:27.735450 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 486/995] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:27.740584 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22a34-6f4b-46f9-b0ba-d2cd80d7c46a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:27.740835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22a34-6f4b-46f9-b0ba-d2cd80d7c46a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:27.741075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22a34-6f4b-46f9-b0ba-d2cd80d7c46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:27.759572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a0b22a34-6f4b-46f9-b0ba-d2cd80d7c46a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:27.760776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a0b22a34-6f4b-46f9-b0ba-d2cd80d7c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:27.797813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:27.841431 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 510/996] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:27.864388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb3a0b-b6e8-4596-89da-eeae3fe6536c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:27.971828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb3a0b-b6e8-4596-89da-eeae3fe6536c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:28.008138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c8d0-22b6-418f-854f-dcf3370c37a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:28.008988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c8d0-22b6-418f-854f-dcf3370c37a4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:28.011022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c8d0-22b6-418f-854f-dcf3370c37a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:28.011022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c8d0-22b6-418f-854f-dcf3370c37a4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:28.011022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c8d0-22b6-418f-854f-dcf3370c37a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:28.011581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c8d0-22b6-418f-854f-dcf3370c37a4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4155c8d0-22b6-418f-854f-dcf3370c37a4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:28.023898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:28.024916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 15:00:28.025778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:28.027203 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 487/997] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:28.031254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b22a34-6f4b-46f9-b0ba-d2cd80d7c46a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:28.133773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b22a34-6f4b-46f9-b0ba-d2cd80d7c46a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:28.168712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56443e-8b79-4842-9a12-8f1448ea0722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:28.169408 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56443e-8b79-4842-9a12-8f1448ea0722 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:28.169687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56443e-8b79-4842-9a12-8f1448ea0722 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:28.169963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56443e-8b79-4842-9a12-8f1448ea0722 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:28.170686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56443e-8b79-4842-9a12-8f1448ea0722 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:28.170995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56443e-8b79-4842-9a12-8f1448ea0722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:28.172364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56443e-8b79-4842-9a12-8f1448ea0722 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:28.177666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 511/998] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 15:00:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:28.183164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c8d0-22b6-418f-854f-dcf3370c37a4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:28.193000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:28.293744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c8d0-22b6-418f-854f-dcf3370c37a4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:28.334210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9ce89-ec8c-436f-8c2d-8d8659e7be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:28.335062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9ce89-ec8c-436f-8c2d-8d8659e7be85 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:28.335243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9ce89-ec8c-436f-8c2d-8d8659e7be85 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:28.335680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9ce89-ec8c-436f-8c2d-8d8659e7be85 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:28.336529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9ce89-ec8c-436f-8c2d-8d8659e7be85 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:28.336833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9ce89-ec8c-436f-8c2d-8d8659e7be85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:28.338244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9ce89-ec8c-436f-8c2d-8d8659e7be85 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:28.343578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 488/999] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 15:00:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:28.349320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56443e-8b79-4842-9a12-8f1448ea0722 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:28.380827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:28.457799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56443e-8b79-4842-9a12-8f1448ea0722 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:28.502866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecba1f-20ae-4b4a-9fc8-e504baf6f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:28.503613 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecba1f-20ae-4b4a-9fc8-e504baf6f91e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:28.503882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecba1f-20ae-4b4a-9fc8-e504baf6f91e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:28.504163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecba1f-20ae-4b4a-9fc8-e504baf6f91e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:28.504994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecba1f-20ae-4b4a-9fc8-e504baf6f91e None admin] RBAC: Adding query filter params (interface=public, service_id=db1b904b80974eb7b47a6153357aba8a, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:28.505334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecba1f-20ae-4b4a-9fc8-e504baf6f91e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:28.506759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecba1f-20ae-4b4a-9fc8-e504baf6f91e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:28.517378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 512/1000] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 17 15:00:28 2022] GET /identity/v3/endpoints?service_id=db1b904b80974eb7b47a6153357aba8a&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:28.521925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9ce89-ec8c-436f-8c2d-8d8659e7be85 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:28.584676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0ee0a-eb93-4762-88e8-4b4be312c8c1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:28.584884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0ee0a-eb93-4762-88e8-4b4be312c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:28.585152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0ee0a-eb93-4762-88e8-4b4be312c8c1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:28.586873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 513/1001] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:28.592845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215c349-a8b0-49d2-9931-17316244a995 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:28.593131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215c349-a8b0-49d2-9931-17316244a995 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:28.593411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215c349-a8b0-49d2-9931-17316244a995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:28.610750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9215c349-a8b0-49d2-9931-17316244a995 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:28.611456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:28.611974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9215c349-a8b0-49d2-9931-17316244a995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:28.650133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9ce89-ec8c-436f-8c2d-8d8659e7be85 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:28.687593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 514/1002] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:28.687790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ac694-8c5a-4131-8ae7-3ee13253fad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:28.688477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ac694-8c5a-4131-8ae7-3ee13253fad8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:28.688726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ac694-8c5a-4131-8ae7-3ee13253fad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:28.689006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ac694-8c5a-4131-8ae7-3ee13253fad8 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:28.689727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ac694-8c5a-4131-8ae7-3ee13253fad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:28.691115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ac694-8c5a-4131-8ae7-3ee13253fad8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:28.700557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 489/1003] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 17 15:00:28 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:00:28.711340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215c349-a8b0-49d2-9931-17316244a995 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:28.739204 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:28.837964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215c349-a8b0-49d2-9931-17316244a995 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:28.875034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe722f48-c3c1-4788-b8eb-1cff767db28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:28.876069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe722f48-c3c1-4788-b8eb-1cff767db28e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:28.876177 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe722f48-c3c1-4788-b8eb-1cff767db28e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:28.876402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe722f48-c3c1-4788-b8eb-1cff767db28e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:28.877787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe722f48-c3c1-4788-b8eb-1cff767db28e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:28.879077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe722f48-c3c1-4788-b8eb-1cff767db28e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fe722f48-c3c1-4788-b8eb-1cff767db28e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:28.891738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:28.893361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:28.894547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 515/1004] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 17 15:00:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:28.900587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ac694-8c5a-4131-8ae7-3ee13253fad8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:29.008096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ac694-8c5a-4131-8ae7-3ee13253fad8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:29.042482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04ca68-0497-4610-b2bc-bc0ed01ff6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:29.043155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04ca68-0497-4610-b2bc-bc0ed01ff6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:29.043428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04ca68-0497-4610-b2bc-bc0ed01ff6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:29.043702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04ca68-0497-4610-b2bc-bc0ed01ff6d4 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:29.044405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04ca68-0497-4610-b2bc-bc0ed01ff6d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:29.044705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04ca68-0497-4610-b2bc-bc0ed01ff6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:29.046107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04ca68-0497-4610-b2bc-bc0ed01ff6d4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:29.047259 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:29.053538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 490/1005] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 17 15:00:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:29.058467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe722f48-c3c1-4788-b8eb-1cff767db28e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:29.146854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:29.164765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe722f48-c3c1-4788-b8eb-1cff767db28e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:29.204393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fb261-1ff7-443a-b4c1-d6b6e25fb335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:29.205294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fb261-1ff7-443a-b4c1-d6b6e25fb335 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:29.205703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fb261-1ff7-443a-b4c1-d6b6e25fb335 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:29.206113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fb261-1ff7-443a-b4c1-d6b6e25fb335 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:29.206984 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fb261-1ff7-443a-b4c1-d6b6e25fb335 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:29.207422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fb261-1ff7-443a-b4c1-d6b6e25fb335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:29.208953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fb261-1ff7-443a-b4c1-d6b6e25fb335 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:29.214668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 516/1006] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 17 15:00:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:29.220119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04ca68-0497-4610-b2bc-bc0ed01ff6d4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:29.326444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04ca68-0497-4610-b2bc-bc0ed01ff6d4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:29.361391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbd683-cc89-46b6-98ba-c9a1083790c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:29.362043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbd683-cc89-46b6-98ba-c9a1083790c2 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:29.362315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbd683-cc89-46b6-98ba-c9a1083790c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:29.362591 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbd683-cc89-46b6-98ba-c9a1083790c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:29.363345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbd683-cc89-46b6-98ba-c9a1083790c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:29.364724 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbd683-cc89-46b6-98ba-c9a1083790c2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:29.385255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 491/1007] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 17 15:00:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:29.708082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193bde8-0e8e-4728-ab35-12f484d285d0 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:29.708435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193bde8-0e8e-4728-ab35-12f484d285d0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:29.708643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193bde8-0e8e-4728-ab35-12f484d285d0 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:29.710269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 517/1008] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:29.715578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f5749-187a-4f98-b069-4cac4623a9c9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:29.715827 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f5749-187a-4f98-b069-4cac4623a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:29.716138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f5749-187a-4f98-b069-4cac4623a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:29.733613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0e3f5749-187a-4f98-b069-4cac4623a9c9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:29.734822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0e3f5749-187a-4f98-b069-4cac4623a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:29.799140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:29.824605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 492/1009] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:29.848036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193bde8-0e8e-4728-ab35-12f484d285d0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:29.954987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193bde8-0e8e-4728-ab35-12f484d285d0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:29.990473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540abf5-3352-4a16-b4fe-94fa40304e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:29.991138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540abf5-3352-4a16-b4fe-94fa40304e4a None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:29.991417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540abf5-3352-4a16-b4fe-94fa40304e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:29.991729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540abf5-3352-4a16-b4fe-94fa40304e4a None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:29.992471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540abf5-3352-4a16-b4fe-94fa40304e4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:29.993868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540abf5-3352-4a16-b4fe-94fa40304e4a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:30.010165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 518/1010] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 15:00:29 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:30.886235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c9e2-abae-4b02-9079-73eedac2cf60 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:30.886779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c9e2-abae-4b02-9079-73eedac2cf60 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:30.886779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c9e2-abae-4b02-9079-73eedac2cf60 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:30.888618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 493/1011] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:30.894042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa187c5-70d5-461e-a3e3-8d8810b9e8fb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:30.894453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa187c5-70d5-461e-a3e3-8d8810b9e8fb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:30.894631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa187c5-70d5-461e-a3e3-8d8810b9e8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:30.912205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4aa187c5-70d5-461e-a3e3-8d8810b9e8fb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:30.913660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4aa187c5-70d5-461e-a3e3-8d8810b9e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:30.916610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:31.001395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 519/1012] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:30 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:31.020210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2c9e2-abae-4b02-9079-73eedac2cf60 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:31.134405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2c9e2-abae-4b02-9079-73eedac2cf60 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:31.174149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71683463-0bc9-411d-94fe-167b63d748c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:31.174954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71683463-0bc9-411d-94fe-167b63d748c7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:31.175228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71683463-0bc9-411d-94fe-167b63d748c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:31.175500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71683463-0bc9-411d-94fe-167b63d748c7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:31.176154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71683463-0bc9-411d-94fe-167b63d748c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:31.177570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71683463-0bc9-411d-94fe-167b63d748c7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-71683463-0bc9-411d-94fe-167b63d748c7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:31.190021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:31.191065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 15:00:31.191885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:31.193433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 494/1013] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:31.198685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa187c5-70d5-461e-a3e3-8d8810b9e8fb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:31.302942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa187c5-70d5-461e-a3e3-8d8810b9e8fb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:31.339171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbe88d-fcff-4c22-aa9c-a0678b997523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:31.339830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe88d-fcff-4c22-aa9c-a0678b997523 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:31.340108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe88d-fcff-4c22-aa9c-a0678b997523 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:31.340379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe88d-fcff-4c22-aa9c-a0678b997523 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:31.341076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbe88d-fcff-4c22-aa9c-a0678b997523 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:31.341408 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbe88d-fcff-4c22-aa9c-a0678b997523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:31.342776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbe88d-fcff-4c22-aa9c-a0678b997523 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:31.344631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:31.348550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 520/1014] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 15:00:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:31.354508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71683463-0bc9-411d-94fe-167b63d748c7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:31.408710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:31.463139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71683463-0bc9-411d-94fe-167b63d748c7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:31.504839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052eb12-ef0e-473a-be20-edabf8272a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:31.505652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052eb12-ef0e-473a-be20-edabf8272a85 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:31.505931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052eb12-ef0e-473a-be20-edabf8272a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:31.506210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052eb12-ef0e-473a-be20-edabf8272a85 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:31.507014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052eb12-ef0e-473a-be20-edabf8272a85 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:31.507348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052eb12-ef0e-473a-be20-edabf8272a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:31.508741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052eb12-ef0e-473a-be20-edabf8272a85 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:31.519293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 495/1015] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 17 15:00:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:31.520550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbe88d-fcff-4c22-aa9c-a0678b997523 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:31.543425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12213bee-74cb-4ef1-810c-e1a2392d2b67 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:31.543759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12213bee-74cb-4ef1-810c-e1a2392d2b67 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:31.544319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12213bee-74cb-4ef1-810c-e1a2392d2b67 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:31.545785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 496/1016] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:31.550940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dfa46-cf67-4ec7-ba38-5daebcd7e704 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:31.551252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dfa46-cf67-4ec7-ba38-5daebcd7e704 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:31.551495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dfa46-cf67-4ec7-ba38-5daebcd7e704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:31.569806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cf0dfa46-cf67-4ec7-ba38-5daebcd7e704 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:31.571181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cf0dfa46-cf67-4ec7-ba38-5daebcd7e704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:31.650523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbe88d-fcff-4c22-aa9c-a0678b997523 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:31.661498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 497/1017] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:31 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:31.675469 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dfa46-cf67-4ec7-ba38-5daebcd7e704 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:31.686892 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fac8a-924d-4578-be25-0d5ab78d1af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:31.687563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fac8a-924d-4578-be25-0d5ab78d1af2 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:31.687845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fac8a-924d-4578-be25-0d5ab78d1af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:31.688123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fac8a-924d-4578-be25-0d5ab78d1af2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:31.688873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fac8a-924d-4578-be25-0d5ab78d1af2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:31.690291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fac8a-924d-4578-be25-0d5ab78d1af2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:31.721236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 521/1018] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 17 15:00:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:00:31.734836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:31.814765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dfa46-cf67-4ec7-ba38-5daebcd7e704 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:31.862781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef326c-d7a4-4194-942e-8ea1d535a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:31.863595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef326c-d7a4-4194-942e-8ea1d535a1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:31.863878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef326c-d7a4-4194-942e-8ea1d535a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:31.864149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef326c-d7a4-4194-942e-8ea1d535a1b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:31.865411 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef326c-d7a4-4194-942e-8ea1d535a1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:31.867458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef326c-d7a4-4194-942e-8ea1d535a1b7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:31.869457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 498/1019] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:31.876724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fac8a-924d-4578-be25-0d5ab78d1af2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:31.942607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:31.996095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fac8a-924d-4578-be25-0d5ab78d1af2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:32.036161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39d944-bd80-4554-99ed-2aa2cc5a8f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:32.036834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39d944-bd80-4554-99ed-2aa2cc5a8f51 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:32.037114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39d944-bd80-4554-99ed-2aa2cc5a8f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:32.037429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39d944-bd80-4554-99ed-2aa2cc5a8f51 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:32.038146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39d944-bd80-4554-99ed-2aa2cc5a8f51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:32.039752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39d944-bd80-4554-99ed-2aa2cc5a8f51 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:32.070312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 522/1020] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 15:00:31 2022] POST /identity/v3/projects => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:32.181915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1570-77f8-4cf3-a189-db8a652e26db None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:32.182468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1570-77f8-4cf3-a189-db8a652e26db None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:32.182468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1570-77f8-4cf3-a189-db8a652e26db None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:32.184051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 499/1021] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:32.189732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a14224-0a9c-49bb-ae20-c1d74671ac81 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:32.190066 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a14224-0a9c-49bb-ae20-c1d74671ac81 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:32.190279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a14224-0a9c-49bb-ae20-c1d74671ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:32.209248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-66a14224-0a9c-49bb-ae20-c1d74671ac81 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:32.210413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-66a14224-0a9c-49bb-ae20-c1d74671ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:32.289658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 523/1022] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:32.312990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1570-77f8-4cf3-a189-db8a652e26db None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:32.418155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1570-77f8-4cf3-a189-db8a652e26db None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:32.426106 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:32.456200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8ddcc-e9f9-4608-8a2c-c95809ee8203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:32.457006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8ddcc-e9f9-4608-8a2c-c95809ee8203 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:32.457313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8ddcc-e9f9-4608-8a2c-c95809ee8203 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:32.457590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8ddcc-e9f9-4608-8a2c-c95809ee8203 None admin] PATH_INFO: `/v3/services/image` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:32.458243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8ddcc-e9f9-4608-8a2c-c95809ee8203 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:32.459698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8ddcc-e9f9-4608-8a2c-c95809ee8203 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-eda8ddcc-e9f9-4608-8a2c-c95809ee8203 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:32.471846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:32.473085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:32.474188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 500/1023] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Jun 17 15:00:32 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:32.480531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a14224-0a9c-49bb-ae20-c1d74671ac81 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:32.527982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:32.599808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a14224-0a9c-49bb-ae20-c1d74671ac81 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:32.640739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496b70-2ec5-4f91-8a97-f8ccd0c5334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:32.641453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496b70-2ec5-4f91-8a97-f8ccd0c5334c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:32.641737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496b70-2ec5-4f91-8a97-f8ccd0c5334c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:32.642012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496b70-2ec5-4f91-8a97-f8ccd0c5334c None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:32.642726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36496b70-2ec5-4f91-8a97-f8ccd0c5334c None admin] RBAC: Adding query filter params (name=image) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:32.643033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36496b70-2ec5-4f91-8a97-f8ccd0c5334c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:32.644403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36496b70-2ec5-4f91-8a97-f8ccd0c5334c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:32.655217 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 524/1024] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:32.656195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8ddcc-e9f9-4608-8a2c-c95809ee8203 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:32.764899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8ddcc-e9f9-4608-8a2c-c95809ee8203 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:32.807147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68a418-37bf-4725-97ea-91e1bd95a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:32.807832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68a418-37bf-4725-97ea-91e1bd95a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:32.808116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68a418-37bf-4725-97ea-91e1bd95a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:32.808689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68a418-37bf-4725-97ea-91e1bd95a4c1 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:32.809431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68a418-37bf-4725-97ea-91e1bd95a4c1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:32.809744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68a418-37bf-4725-97ea-91e1bd95a4c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:32.811136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68a418-37bf-4725-97ea-91e1bd95a4c1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:32.816666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 501/1025] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:32.822477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496b70-2ec5-4f91-8a97-f8ccd0c5334c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:32.927361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496b70-2ec5-4f91-8a97-f8ccd0c5334c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:32.928940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:32.969593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82c974-2a5b-4eec-8468-30f35c3dc23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:32.970253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82c974-2a5b-4eec-8468-30f35c3dc23e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:32.970515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82c974-2a5b-4eec-8468-30f35c3dc23e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:32.970796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82c974-2a5b-4eec-8468-30f35c3dc23e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:32.971589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82c974-2a5b-4eec-8468-30f35c3dc23e None admin] RBAC: Adding query filter params (interface=public, service_id=023e892e7ce9428fafbf558077abe8b2, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:32.971904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82c974-2a5b-4eec-8468-30f35c3dc23e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:32.973299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82c974-2a5b-4eec-8468-30f35c3dc23e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:32.979331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 525/1026] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 17 15:00:32 2022] GET /identity/v3/endpoints?service_id=023e892e7ce9428fafbf558077abe8b2&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:32.984941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68a418-37bf-4725-97ea-91e1bd95a4c1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:33.035001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:33.107602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68a418-37bf-4725-97ea-91e1bd95a4c1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:33.141798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8de89-6130-467b-bcad-b9f261d8be52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:33.142513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8de89-6130-467b-bcad-b9f261d8be52 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:33.142798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8de89-6130-467b-bcad-b9f261d8be52 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:33.143075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8de89-6130-467b-bcad-b9f261d8be52 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:33.143767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8de89-6130-467b-bcad-b9f261d8be52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:33.145150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8de89-6130-467b-bcad-b9f261d8be52 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:33.157577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 502/1027] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 17 15:00:32 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:00:33.983673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e1c0e-d6d9-4467-99b2-0eac929fb096 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:33.984226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e1c0e-d6d9-4467-99b2-0eac929fb096 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:33.984226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e1c0e-d6d9-4467-99b2-0eac929fb096 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:33.985877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 526/1028] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:33.991251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218bdfd-e359-4982-b313-6e2512d153ff None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:33.991725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218bdfd-e359-4982-b313-6e2512d153ff None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:33.991914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218bdfd-e359-4982-b313-6e2512d153ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:34.009199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9218bdfd-e359-4982-b313-6e2512d153ff None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:34.010402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9218bdfd-e359-4982-b313-6e2512d153ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:34.079378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 503/1029] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:34.102318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e1c0e-d6d9-4467-99b2-0eac929fb096 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:34.210750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e1c0e-d6d9-4467-99b2-0eac929fb096 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:34.247769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d938381-8121-46b7-ab18-94534011fec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:34.248631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938381-8121-46b7-ab18-94534011fec2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:34.248910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938381-8121-46b7-ab18-94534011fec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:34.249172 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938381-8121-46b7-ab18-94534011fec2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:34.262869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d938381-8121-46b7-ab18-94534011fec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1d938381-8121-46b7-ab18-94534011fec2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:34.271363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:34.272438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:34.278881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 527/1030] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 17 15:00:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:34.285605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218bdfd-e359-4982-b313-6e2512d153ff None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:34.325644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:34.348423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1e4c-a02a-40b0-bcf9-766f26b401e3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:34.348626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1e4c-a02a-40b0-bcf9-766f26b401e3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:34.349465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1e4c-a02a-40b0-bcf9-766f26b401e3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:34.351472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 528/1031] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:34.356517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b5b5-3035-4f12-aa6c-2c10dc4bbd71 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:34.357381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b5b5-3035-4f12-aa6c-2c10dc4bbd71 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:34.357663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b5b5-3035-4f12-aa6c-2c10dc4bbd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:34.380306 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f0f2b5b5-3035-4f12-aa6c-2c10dc4bbd71 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:34.382058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f0f2b5b5-3035-4f12-aa6c-2c10dc4bbd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:34.408626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218bdfd-e359-4982-b313-6e2512d153ff None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:34.409306 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:34.447785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ef54e-959a-4791-9ac2-928d0dbafd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:34.448461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ef54e-959a-4791-9ac2-928d0dbafd79 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:34.448739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ef54e-959a-4791-9ac2-928d0dbafd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:34.449012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ef54e-959a-4791-9ac2-928d0dbafd79 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:34.450141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ef54e-959a-4791-9ac2-928d0dbafd79 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:34.450442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ef54e-959a-4791-9ac2-928d0dbafd79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:34.451817 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ef54e-959a-4791-9ac2-928d0dbafd79 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:34.461063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 504/1032] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 17 15:00:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:34.462617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 529/1033] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:34.467138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ef54e-959a-4791-9ac2-928d0dbafd79 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:34.487296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b5b5-3035-4f12-aa6c-2c10dc4bbd71 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:34.566975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:34.577940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ef54e-959a-4791-9ac2-928d0dbafd79 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:34.588934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b5b5-3035-4f12-aa6c-2c10dc4bbd71 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:34.613384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14089571-c6d6-45e5-afcc-55cd78f5eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:34.614106 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14089571-c6d6-45e5-afcc-55cd78f5eac3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:34.614382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14089571-c6d6-45e5-afcc-55cd78f5eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:34.614671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14089571-c6d6-45e5-afcc-55cd78f5eac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:34.625533 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14089571-c6d6-45e5-afcc-55cd78f5eac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:34.626528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74357687-11dc-4740-bed2-0a9a912e22d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:34.626987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14089571-c6d6-45e5-afcc-55cd78f5eac3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:34.627382 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74357687-11dc-4740-bed2-0a9a912e22d3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:34.627664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74357687-11dc-4740-bed2-0a9a912e22d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:34.627941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74357687-11dc-4740-bed2-0a9a912e22d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:34.629142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74357687-11dc-4740-bed2-0a9a912e22d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:34.633456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74357687-11dc-4740-bed2-0a9a912e22d3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:34.635251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 530/1034] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:34.640829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74357687-11dc-4740-bed2-0a9a912e22d3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-14089571-c6d6-45e5-afcc-55cd78f5eac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:34.648679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:34.655689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:34.656701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:34.656701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:34.656701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:34.656701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:34.656701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 505/1035] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:34.658889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14089571-c6d6-45e5-afcc-55cd78f5eac3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:34.674443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:34.755924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74357687-11dc-4740-bed2-0a9a912e22d3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:34.775592 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14089571-c6d6-45e5-afcc-55cd78f5eac3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:34.795812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83540218-8555-4511-904c-0b4f3054a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:34.796589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83540218-8555-4511-904c-0b4f3054a030 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:34.796864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83540218-8555-4511-904c-0b4f3054a030 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:34.797132 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83540218-8555-4511-904c-0b4f3054a030 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:34.797954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83540218-8555-4511-904c-0b4f3054a030 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:34.799390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83540218-8555-4511-904c-0b4f3054a030 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:34.824092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 531/1036] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 15:00:34 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:34.836095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f541695-6be1-47b0-95ed-f8668731f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:34.836800 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f541695-6be1-47b0-95ed-f8668731f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:34.837076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f541695-6be1-47b0-95ed-f8668731f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:34.837385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f541695-6be1-47b0-95ed-f8668731f6d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:34.838176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f541695-6be1-47b0-95ed-f8668731f6d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:34.838489 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f541695-6be1-47b0-95ed-f8668731f6d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:34.839954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f541695-6be1-47b0-95ed-f8668731f6d5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:34.854159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 506/1037] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:34.860109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83540218-8555-4511-904c-0b4f3054a030 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:34.952883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:34.977953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83540218-8555-4511-904c-0b4f3054a030 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:35.018189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced59978-3ce1-4178-8f35-6d46885d5551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:35.019052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced59978-3ce1-4178-8f35-6d46885d5551 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:35.019382 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced59978-3ce1-4178-8f35-6d46885d5551 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:35.019664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced59978-3ce1-4178-8f35-6d46885d5551 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:35.028291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced59978-3ce1-4178-8f35-6d46885d5551 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:35.029755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced59978-3ce1-4178-8f35-6d46885d5551 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ced59978-3ce1-4178-8f35-6d46885d5551 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:35.044157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:35.045167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:35.046192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 532/1038] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 17 15:00:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:35.051604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f541695-6be1-47b0-95ed-f8668731f6d5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:35.054866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:35.164686 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f541695-6be1-47b0-95ed-f8668731f6d5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:35.205445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093912c-6d3b-4994-b54d-dc804615ced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:35.206035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093912c-6d3b-4994-b54d-dc804615ced3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:35.206285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093912c-6d3b-4994-b54d-dc804615ced3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:35.206585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093912c-6d3b-4994-b54d-dc804615ced3 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:35.207421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093912c-6d3b-4994-b54d-dc804615ced3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:35.207721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093912c-6d3b-4994-b54d-dc804615ced3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:35.209180 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093912c-6d3b-4994-b54d-dc804615ced3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:35.227340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 507/1039] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 17 15:00:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:35.232876 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced59978-3ce1-4178-8f35-6d46885d5551 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:35.340258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9827a-0f1a-4c0e-b85e-62492d331be4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:35.340499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9827a-0f1a-4c0e-b85e-62492d331be4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:35.340783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9827a-0f1a-4c0e-b85e-62492d331be4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:35.342215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 508/1040] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:35.343982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced59978-3ce1-4178-8f35-6d46885d5551 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:35.347151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e0c2e-dd37-4915-894e-cae004100f9c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:35.347440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e0c2e-dd37-4915-894e-cae004100f9c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:35.347720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e0c2e-dd37-4915-894e-cae004100f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:35.364690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1c9e0c2e-dd37-4915-894e-cae004100f9c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:35.365908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1c9e0c2e-dd37-4915-894e-cae004100f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:35.380090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e6eda-ce35-4cbe-863f-0f0768905a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:35.380741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6eda-ce35-4cbe-863f-0f0768905a0a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:35.381021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6eda-ce35-4cbe-863f-0f0768905a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:35.381564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6eda-ce35-4cbe-863f-0f0768905a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:35.393343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:35.429194 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:35.445246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 509/1041] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:35.462757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e6eda-ce35-4cbe-863f-0f0768905a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:35.464137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e6eda-ce35-4cbe-863f-0f0768905a0a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:35.465731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e0c2e-dd37-4915-894e-cae004100f9c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:35.576534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e0c2e-dd37-4915-894e-cae004100f9c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:35.578306 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 533/1042] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:00:35.584011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e6eda-ce35-4cbe-863f-0f0768905a0a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:35.618205 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9fc2c-e869-417c-acd9-77e7583a62ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:35.619014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9fc2c-e869-417c-acd9-77e7583a62ff None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:35.619298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9fc2c-e869-417c-acd9-77e7583a62ff None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:35.619616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9fc2c-e869-417c-acd9-77e7583a62ff None admin] PATH_INFO: `/v3/services/image` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:35.620284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9fc2c-e869-417c-acd9-77e7583a62ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:35.621710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9fc2c-e869-417c-acd9-77e7583a62ff None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:35.627345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8fc9fc2c-e869-417c-acd9-77e7583a62ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:35.633634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:35.634794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:35.635655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 510/1043] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Jun 17 15:00:35 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:35.640883 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9fc2c-e869-417c-acd9-77e7583a62ff None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:35.693477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e6eda-ce35-4cbe-863f-0f0768905a0a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:35.702964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:35.730597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fb3e1-06ba-46cb-8671-7e024ff048b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:35.731749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fb3e1-06ba-46cb-8671-7e024ff048b0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:35.732258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fb3e1-06ba-46cb-8671-7e024ff048b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:35.732645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fb3e1-06ba-46cb-8671-7e024ff048b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:35.743930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fb3e1-06ba-46cb-8671-7e024ff048b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:35.745411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fb3e1-06ba-46cb-8671-7e024ff048b0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:35.752241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9fc2c-e869-417c-acd9-77e7583a62ff None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e65fb3e1-06ba-46cb-8671-7e024ff048b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:35.764517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:35.765587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:35.766478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:35.766478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:35.766478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:35.766478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:35.766478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 534/1044] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:35.771741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fb3e1-06ba-46cb-8671-7e024ff048b0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:35.793458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff339f-4ae6-477d-a42e-13783b10db6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:35.794361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff339f-4ae6-477d-a42e-13783b10db6a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:35.794648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff339f-4ae6-477d-a42e-13783b10db6a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:35.794924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff339f-4ae6-477d-a42e-13783b10db6a None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:35.795759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff339f-4ae6-477d-a42e-13783b10db6a None admin] RBAC: Adding query filter params (name=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:35.796071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff339f-4ae6-477d-a42e-13783b10db6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:35.797528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff339f-4ae6-477d-a42e-13783b10db6a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:35.803063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 511/1045] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:35.809787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff339f-4ae6-477d-a42e-13783b10db6a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:35.879035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:35.889258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fb3e1-06ba-46cb-8671-7e024ff048b0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:35.917638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff339f-4ae6-477d-a42e-13783b10db6a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:35.924053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c7904-c088-4a8a-9795-e0b9553df252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:35.924726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c7904-c088-4a8a-9795-e0b9553df252 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:35.925015 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c7904-c088-4a8a-9795-e0b9553df252 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:35.925325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c7904-c088-4a8a-9795-e0b9553df252 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:35.926053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c7904-c088-4a8a-9795-e0b9553df252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:35.926363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c7904-c088-4a8a-9795-e0b9553df252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:35.927737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c7904-c088-4a8a-9795-e0b9553df252 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:35.936701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:35.942614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 535/1046] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:35.948208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c7904-c088-4a8a-9795-e0b9553df252 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:35.962135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c7b2-4c1e-4ae3-a5b3-a19207212603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:35.962807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c7b2-4c1e-4ae3-a5b3-a19207212603 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:35.963087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c7b2-4c1e-4ae3-a5b3-a19207212603 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:35.963363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c7b2-4c1e-4ae3-a5b3-a19207212603 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:35.964072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69c7b2-4c1e-4ae3-a5b3-a19207212603 None admin] RBAC: Adding query filter params (type=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:35.964379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69c7b2-4c1e-4ae3-a5b3-a19207212603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:35.965796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69c7b2-4c1e-4ae3-a5b3-a19207212603 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:35.975600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 512/1047] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:35.977151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c7b2-4c1e-4ae3-a5b3-a19207212603 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:36.059783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c7904-c088-4a8a-9795-e0b9553df252 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:36.089902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c7b2-4c1e-4ae3-a5b3-a19207212603 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:36.100397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924b483-cfd6-46aa-bc7f-ea887aac3fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:36.101523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924b483-cfd6-46aa-bc7f-ea887aac3fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:36.101811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924b483-cfd6-46aa-bc7f-ea887aac3fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:36.102086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924b483-cfd6-46aa-bc7f-ea887aac3fe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:36.109477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924b483-cfd6-46aa-bc7f-ea887aac3fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:36.110919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924b483-cfd6-46aa-bc7f-ea887aac3fe3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:36.125584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a90f3d-c982-4bd3-a796-fbd42b534ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:36.126252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a90f3d-c982-4bd3-a796-fbd42b534ce7 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:36.126532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a90f3d-c982-4bd3-a796-fbd42b534ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5924b483-cfd6-46aa-bc7f-ea887aac3fe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:36.126637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:36.127513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:36.133863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:36.133863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:36.133863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:36.133863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:36.133863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:36.133863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:36.133863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:36.133863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:36.134335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a90f3d-c982-4bd3-a796-fbd42b534ce7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:36.134335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a90f3d-c982-4bd3-a796-fbd42b534ce7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:36.134472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 536/1048] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:36.134571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a90f3d-c982-4bd3-a796-fbd42b534ce7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:36.134643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924b483-cfd6-46aa-bc7f-ea887aac3fe3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:36.150549 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:36.165243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 513/1049] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 17 15:00:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:36.247403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924b483-cfd6-46aa-bc7f-ea887aac3fe3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:36.292784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb53cd-a4ca-46ac-a9bd-76499893f5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:36.293469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb53cd-a4ca-46ac-a9bd-76499893f5bd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:36.293748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb53cd-a4ca-46ac-a9bd-76499893f5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:36.294014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb53cd-a4ca-46ac-a9bd-76499893f5bd None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:36.294799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb53cd-a4ca-46ac-a9bd-76499893f5bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:36.295098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb53cd-a4ca-46ac-a9bd-76499893f5bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:36.296539 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb53cd-a4ca-46ac-a9bd-76499893f5bd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:36.317564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 537/1050] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:36.318892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a90f3d-c982-4bd3-a796-fbd42b534ce7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:36.365847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:36.433170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a90f3d-c982-4bd3-a796-fbd42b534ce7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:36.468970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11233f-1192-4c0e-86a7-a8df842c0030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:36.469654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11233f-1192-4c0e-86a7-a8df842c0030 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:36.469931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11233f-1192-4c0e-86a7-a8df842c0030 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:36.470203 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11233f-1192-4c0e-86a7-a8df842c0030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:36.471023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11233f-1192-4c0e-86a7-a8df842c0030 None admin] RBAC: Adding query filter params (role.id=9c81eb93ab264328b493f7e8b54e2611, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=ca11a9d339bb4e799dc4e5531147ddda) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:36.471330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11233f-1192-4c0e-86a7-a8df842c0030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:36.472794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11233f-1192-4c0e-86a7-a8df842c0030 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:36.479017 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 514/1051] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:36 2022] GET /identity/v3/role_assignments?user.id=ca11a9d339bb4e799dc4e5531147ddda&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=9c81eb93ab264328b493f7e8b54e2611 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:37.118911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8246f-2a2d-47cd-bc42-9444149e3282 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:37.119451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8246f-2a2d-47cd-bc42-9444149e3282 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:37.119451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8246f-2a2d-47cd-bc42-9444149e3282 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:37.120945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 538/1052] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:37.126305 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01b40-6484-496c-82bd-24cbef367014 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:37.126708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01b40-6484-496c-82bd-24cbef367014 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:37.126782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01b40-6484-496c-82bd-24cbef367014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:37.144329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4ec01b40-6484-496c-82bd-24cbef367014 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:37.145545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4ec01b40-6484-496c-82bd-24cbef367014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:37.219692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 515/1053] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:37.244597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8246f-2a2d-47cd-bc42-9444149e3282 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:37.320450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:37.360409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8246f-2a2d-47cd-bc42-9444149e3282 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:37.398033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082426d-c4fc-4ced-aa32-4f34411668c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:37.398745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082426d-c4fc-4ced-aa32-4f34411668c6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:37.399022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082426d-c4fc-4ced-aa32-4f34411668c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:37.399298 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082426d-c4fc-4ced-aa32-4f34411668c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:37.410165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082426d-c4fc-4ced-aa32-4f34411668c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7082426d-c4fc-4ced-aa32-4f34411668c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:37.418186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:37.419164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:37.420036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 539/1054] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:00:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:37.425529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01b40-6484-496c-82bd-24cbef367014 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:37.458461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:37.532910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01b40-6484-496c-82bd-24cbef367014 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:37.571298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491af24-4e63-43cb-b260-b996972a8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:37.571971 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491af24-4e63-43cb-b260-b996972a8694 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:37.572253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491af24-4e63-43cb-b260-b996972a8694 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:37.572528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491af24-4e63-43cb-b260-b996972a8694 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:37.573301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491af24-4e63-43cb-b260-b996972a8694 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:37.573600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491af24-4e63-43cb-b260-b996972a8694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:37.575319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491af24-4e63-43cb-b260-b996972a8694 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:37.584378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 516/1055] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:00:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:37.590378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082426d-c4fc-4ced-aa32-4f34411668c6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:37.694949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082426d-c4fc-4ced-aa32-4f34411668c6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:37.721026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:37.730670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb482-69a9-4a87-9a5b-5f0ab0a9f78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:37.731558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb482-69a9-4a87-9a5b-5f0ab0a9f78c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:37.731835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb482-69a9-4a87-9a5b-5f0ab0a9f78c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:37.732106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb482-69a9-4a87-9a5b-5f0ab0a9f78c None admin] PATH_INFO: `/v3/users/2c6abc9ade924a71b2459a7f043dac72` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:37.745663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cb482-69a9-4a87-9a5b-5f0ab0a9f78c None admin] RBAC: Authorizing `identity:get_user(user_id=2c6abc9ade924a71b2459a7f043dac72)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:37.747110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cb482-69a9-4a87-9a5b-5f0ab0a9f78c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:37.753403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 540/1056] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:00:37 2022] GET /identity/v3/users/2c6abc9ade924a71b2459a7f043dac72 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:37.754624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491af24-4e63-43cb-b260-b996972a8694 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:37.854425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:37.861599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491af24-4e63-43cb-b260-b996972a8694 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:37.895928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f954d-472f-4c95-8cad-bc53b4685bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:37.896582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f954d-472f-4c95-8cad-bc53b4685bbb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:37.896851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f954d-472f-4c95-8cad-bc53b4685bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:37.897140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f954d-472f-4c95-8cad-bc53b4685bbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:37.968829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f954d-472f-4c95-8cad-bc53b4685bbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:37.970221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f954d-472f-4c95-8cad-bc53b4685bbb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:38.069157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:38.078758 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 517/1057] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:00:38.084606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb482-69a9-4a87-9a5b-5f0ab0a9f78c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:38.184416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb482-69a9-4a87-9a5b-5f0ab0a9f78c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:38.219980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48477344-f7a1-4d37-ae24-2d8ea054e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:38.220759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48477344-f7a1-4d37-ae24-2d8ea054e8db None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:38.221033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48477344-f7a1-4d37-ae24-2d8ea054e8db None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:38.221327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48477344-f7a1-4d37-ae24-2d8ea054e8db None admin] PATH_INFO: `/v3/projects/3210889c364f45239673981145f0c688` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:38.222512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48477344-f7a1-4d37-ae24-2d8ea054e8db None admin] RBAC: Authorizing `identity:get_project(project_id=3210889c364f45239673981145f0c688)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:38.223937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48477344-f7a1-4d37-ae24-2d8ea054e8db None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:38.226064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 541/1058] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:00:38 2022] GET /identity/v3/projects/3210889c364f45239673981145f0c688 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:38.231876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f954d-472f-4c95-8cad-bc53b4685bbb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:38.356448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f954d-472f-4c95-8cad-bc53b4685bbb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:38.358307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad521682-b932-4158-936d-11297538d3bb None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:38.358599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad521682-b932-4158-936d-11297538d3bb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:38.358884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad521682-b932-4158-936d-11297538d3bb None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:38.360275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 542/1059] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:38.365109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fecf5f-86de-4777-803c-5ffb93f244a2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:38.365427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fecf5f-86de-4777-803c-5ffb93f244a2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:38.365710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fecf5f-86de-4777-803c-5ffb93f244a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:38.383464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f8fecf5f-86de-4777-803c-5ffb93f244a2 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:38.384704 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f8fecf5f-86de-4777-803c-5ffb93f244a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:38.394084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629685b5-1f9a-4cda-a3b7-67a12bb8f1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:38.394739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629685b5-1f9a-4cda-a3b7-67a12bb8f1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:38.395012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629685b5-1f9a-4cda-a3b7-67a12bb8f1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:38.395282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629685b5-1f9a-4cda-a3b7-67a12bb8f1d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:38.396107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629685b5-1f9a-4cda-a3b7-67a12bb8f1d8 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=3210889c364f45239673981145f0c688, user.id=2c6abc9ade924a71b2459a7f043dac72) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:38.396384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629685b5-1f9a-4cda-a3b7-67a12bb8f1d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:38.398260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629685b5-1f9a-4cda-a3b7-67a12bb8f1d8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:38.409373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 518/1060] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:38 2022] GET /identity/v3/role_assignments?user.id=2c6abc9ade924a71b2459a7f043dac72&scope.project.id=3210889c364f45239673981145f0c688&role.id=8a6fe5045159487aa0119348cfe94387 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:38.444527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:38.465479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 543/1061] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:38.488462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629685b5-1f9a-4cda-a3b7-67a12bb8f1d8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:38.568029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:38.617509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629685b5-1f9a-4cda-a3b7-67a12bb8f1d8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:38.619794 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c506-0072-449e-a428-553ae3d4eadb None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:38.620090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c506-0072-449e-a428-553ae3d4eadb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:38.620377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c506-0072-449e-a428-553ae3d4eadb None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:38.621843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 544/1062] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:38.627356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71f1c5-3144-4d7f-aab0-6ad1d5bf2844 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:38.627648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71f1c5-3144-4d7f-aab0-6ad1d5bf2844 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:38.627946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71f1c5-3144-4d7f-aab0-6ad1d5bf2844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:38.645775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-da71f1c5-3144-4d7f-aab0-6ad1d5bf2844 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:38.646995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-da71f1c5-3144-4d7f-aab0-6ad1d5bf2844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:38.654554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccce70-6b4b-4f20-8c20-2deb5cf80896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:38.655512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccce70-6b4b-4f20-8c20-2deb5cf80896 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:38.655999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccce70-6b4b-4f20-8c20-2deb5cf80896 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:38.656281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccce70-6b4b-4f20-8c20-2deb5cf80896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:38.722013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 545/1063] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:38.733271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccce70-6b4b-4f20-8c20-2deb5cf80896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:38.734906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccce70-6b4b-4f20-8c20-2deb5cf80896 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:38.746769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71f1c5-3144-4d7f-aab0-6ad1d5bf2844 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:38.802610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:38.848727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 519/1064] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:00:38.854619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccce70-6b4b-4f20-8c20-2deb5cf80896 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:38.860796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71f1c5-3144-4d7f-aab0-6ad1d5bf2844 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:38.876186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:38.897674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030186b-0d54-4d0f-9153-b671cd53df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:38.898487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030186b-0d54-4d0f-9153-b671cd53df0f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:38.898770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030186b-0d54-4d0f-9153-b671cd53df0f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:38.899031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030186b-0d54-4d0f-9153-b671cd53df0f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:38.909762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030186b-0d54-4d0f-9153-b671cd53df0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0030186b-0d54-4d0f-9153-b671cd53df0f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:38.918284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:38.919224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:38.920081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 546/1065] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 17 15:00:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:38.925780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030186b-0d54-4d0f-9153-b671cd53df0f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:38.965043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccce70-6b4b-4f20-8c20-2deb5cf80896 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:39.000267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e1dba-2ee2-43c8-b06c-e179b193550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:39.001454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e1dba-2ee2-43c8-b06c-e179b193550e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:39.001880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e1dba-2ee2-43c8-b06c-e179b193550e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:39.002296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e1dba-2ee2-43c8-b06c-e179b193550e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:39.013273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e1dba-2ee2-43c8-b06c-e179b193550e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:39.014750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e1dba-2ee2-43c8-b06c-e179b193550e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-349e1dba-2ee2-43c8-b06c-e179b193550e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:39.033358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:39.034287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:39.035167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:39.035167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:39.035167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:39.035167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:39.035404 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030186b-0d54-4d0f-9153-b671cd53df0f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:39.039609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 520/1066] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:39.040501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e1dba-2ee2-43c8-b06c-e179b193550e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:39.052521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:39.077131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7589d-04c8-468e-92bd-7c36006bdccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:39.078187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7589d-04c8-468e-92bd-7c36006bdccc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:39.078669 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7589d-04c8-468e-92bd-7c36006bdccc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:39.078942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7589d-04c8-468e-92bd-7c36006bdccc None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:39.079686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7589d-04c8-468e-92bd-7c36006bdccc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:39.079983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7589d-04c8-468e-92bd-7c36006bdccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:39.081427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7589d-04c8-468e-92bd-7c36006bdccc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:39.090080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 547/1067] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 17 15:00:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:39.095677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7589d-04c8-468e-92bd-7c36006bdccc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:39.134203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:39.153970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e1dba-2ee2-43c8-b06c-e179b193550e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:39.190950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5f961-332e-4e2b-80f9-7a9b2fdcafd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:39.191617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5f961-332e-4e2b-80f9-7a9b2fdcafd3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:39.191899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5f961-332e-4e2b-80f9-7a9b2fdcafd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:39.192176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5f961-332e-4e2b-80f9-7a9b2fdcafd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:39.192907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5f961-332e-4e2b-80f9-7a9b2fdcafd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:39.193225 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5f961-332e-4e2b-80f9-7a9b2fdcafd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:39.194698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5f961-332e-4e2b-80f9-7a9b2fdcafd3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:39.202327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7589d-04c8-468e-92bd-7c36006bdccc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:39.207996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 521/1068] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:39.241720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2afed5-9f8c-4b36-8092-231f11bbcf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:39.242628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2afed5-9f8c-4b36-8092-231f11bbcf3a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:39.242901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2afed5-9f8c-4b36-8092-231f11bbcf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:39.243170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2afed5-9f8c-4b36-8092-231f11bbcf3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:39.254640 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2afed5-9f8c-4b36-8092-231f11bbcf3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:39.256017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2afed5-9f8c-4b36-8092-231f11bbcf3a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fc2afed5-9f8c-4b36-8092-231f11bbcf3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:39.276201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:39.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:39.283082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:39.283082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:39.283082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:39.283082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:39.283082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 548/1069] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:39.285301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5f961-332e-4e2b-80f9-7a9b2fdcafd3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:39.365671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:39.401751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5f961-332e-4e2b-80f9-7a9b2fdcafd3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:39.438801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59561ba4-8faf-4ba3-9ee9-47d0798d3634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:39.439473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59561ba4-8faf-4ba3-9ee9-47d0798d3634 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:39.439758 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59561ba4-8faf-4ba3-9ee9-47d0798d3634 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:39.440035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59561ba4-8faf-4ba3-9ee9-47d0798d3634 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:39.440768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59561ba4-8faf-4ba3-9ee9-47d0798d3634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:39.441077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59561ba4-8faf-4ba3-9ee9-47d0798d3634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:39.442520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59561ba4-8faf-4ba3-9ee9-47d0798d3634 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:39.461285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 522/1070] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:39.462810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2afed5-9f8c-4b36-8092-231f11bbcf3a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:39.558699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:39.571770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2afed5-9f8c-4b36-8092-231f11bbcf3a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:39.608116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5affcda-efb3-49ba-8f9e-533b3eb8916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:39.608904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5affcda-efb3-49ba-8f9e-533b3eb8916e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:39.609182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5affcda-efb3-49ba-8f9e-533b3eb8916e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:39.609480 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5affcda-efb3-49ba-8f9e-533b3eb8916e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:39.617762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5affcda-efb3-49ba-8f9e-533b3eb8916e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:39.619208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5affcda-efb3-49ba-8f9e-533b3eb8916e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f5affcda-efb3-49ba-8f9e-533b3eb8916e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:39.634347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:39.635342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:39.636376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 549/1071] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 17 15:00:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:39.641573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59561ba4-8faf-4ba3-9ee9-47d0798d3634 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:39.745199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59561ba4-8faf-4ba3-9ee9-47d0798d3634 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:39.774822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:39.781343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd6e0-7bad-47a2-822d-83ff6ee360e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:39.781963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd6e0-7bad-47a2-822d-83ff6ee360e8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:39.782247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd6e0-7bad-47a2-822d-83ff6ee360e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:39.785354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd6e0-7bad-47a2-822d-83ff6ee360e8 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:39.785354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddd6e0-7bad-47a2-822d-83ff6ee360e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:39.785354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddd6e0-7bad-47a2-822d-83ff6ee360e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:39.785354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddd6e0-7bad-47a2-822d-83ff6ee360e8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:39.807353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 523/1072] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 17 15:00:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:39.813421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5affcda-efb3-49ba-8f9e-533b3eb8916e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:39.911545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5affcda-efb3-49ba-8f9e-533b3eb8916e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:39.945235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d41b0-e7bb-4426-a0e5-f3b2fd0184f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:39.946056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d41b0-e7bb-4426-a0e5-f3b2fd0184f4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:39.946328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d41b0-e7bb-4426-a0e5-f3b2fd0184f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:39.946595 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d41b0-e7bb-4426-a0e5-f3b2fd0184f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:39.956888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d41b0-e7bb-4426-a0e5-f3b2fd0184f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:39.958380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d41b0-e7bb-4426-a0e5-f3b2fd0184f4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:39.966874 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fd8d41b0-e7bb-4426-a0e5-f3b2fd0184f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:39.976903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:39.977878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:39.978790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:39.978790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:39.978790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:39.978790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:39.981606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 550/1073] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:39.984094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd6e0-7bad-47a2-822d-83ff6ee360e8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:40.092493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd6e0-7bad-47a2-822d-83ff6ee360e8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:40.129692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931063e7-6b31-49e7-9830-9316f61969cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:40.130361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931063e7-6b31-49e7-9830-9316f61969cf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:40.130620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931063e7-6b31-49e7-9830-9316f61969cf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:40.130892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931063e7-6b31-49e7-9830-9316f61969cf None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:40.131729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931063e7-6b31-49e7-9830-9316f61969cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:40.132599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931063e7-6b31-49e7-9830-9316f61969cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:40.134019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931063e7-6b31-49e7-9830-9316f61969cf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:40.145853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 524/1074] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:40.152179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d41b0-e7bb-4426-a0e5-f3b2fd0184f4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:40.253167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d41b0-e7bb-4426-a0e5-f3b2fd0184f4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:40.286256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8e1a9-3c9d-48b2-892b-8d24f262437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:40.287037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8e1a9-3c9d-48b2-892b-8d24f262437a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:40.287308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8e1a9-3c9d-48b2-892b-8d24f262437a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:40.287576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8e1a9-3c9d-48b2-892b-8d24f262437a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:40.294364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8e1a9-3c9d-48b2-892b-8d24f262437a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:40.295781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8e1a9-3c9d-48b2-892b-8d24f262437a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e8f8e1a9-3c9d-48b2-892b-8d24f262437a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:40.309245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:40.310167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:40.311067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:40.311067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:40.311067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:40.311067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:40.311067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:40.311067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:40.311067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:40.311067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:40.311067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 551/1075] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:40.316449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931063e7-6b31-49e7-9830-9316f61969cf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:40.373181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:40.433152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931063e7-6b31-49e7-9830-9316f61969cf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:40.469593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f85725-9500-4c98-91e5-125d838289a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:40.470271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85725-9500-4c98-91e5-125d838289a9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:40.470548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85725-9500-4c98-91e5-125d838289a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:40.470826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85725-9500-4c98-91e5-125d838289a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:40.471622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85725-9500-4c98-91e5-125d838289a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:40.471927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85725-9500-4c98-91e5-125d838289a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:40.473446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85725-9500-4c98-91e5-125d838289a9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:40.487207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 525/1076] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:40.493903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8e1a9-3c9d-48b2-892b-8d24f262437a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:40.526320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746244b-d3da-4418-9750-305158714187 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:40.526603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746244b-d3da-4418-9750-305158714187 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:40.526878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746244b-d3da-4418-9750-305158714187 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:40.528240 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 526/1077] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:40.533119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebb4af-8cad-43dc-a789-4b84ff1cbeb7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:40.533424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebb4af-8cad-43dc-a789-4b84ff1cbeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:40.533700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebb4af-8cad-43dc-a789-4b84ff1cbeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:40.550111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bfebb4af-8cad-43dc-a789-4b84ff1cbeb7 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:40.551295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bfebb4af-8cad-43dc-a789-4b84ff1cbeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:40.555106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:40.596863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8e1a9-3c9d-48b2-892b-8d24f262437a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:40.619991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 527/1078] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:00:40.630283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17847b-df66-44a0-8ab4-adfede03c5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:40.631187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17847b-df66-44a0-8ab4-adfede03c5d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:40.631461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17847b-df66-44a0-8ab4-adfede03c5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:40.631782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17847b-df66-44a0-8ab4-adfede03c5d4 None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/ca11a9d339bb4e799dc4e5531147ddda/roles/9c81eb93ab264328b493f7e8b54e2611` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:40.634047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17847b-df66-44a0-8ab4-adfede03c5d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=ca11a9d339bb4e799dc4e5531147ddda, role_id=9c81eb93ab264328b493f7e8b54e2611)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:40.635786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17847b-df66-44a0-8ab4-adfede03c5d4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:40.642796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebb4af-8cad-43dc-a789-4b84ff1cbeb7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:40.650650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 552/1079] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 15:00:40 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/ca11a9d339bb4e799dc4e5531147ddda/roles/9c81eb93ab264328b493f7e8b54e2611 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:00:40.686840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:40.753688 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebb4af-8cad-43dc-a789-4b84ff1cbeb7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:40.795430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b0544-f3ab-476c-b545-4d295320baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:40.796345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b0544-f3ab-476c-b545-4d295320baaf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:40.796632 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b0544-f3ab-476c-b545-4d295320baaf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:40.796904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b0544-f3ab-476c-b545-4d295320baaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:40.809451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b0544-f3ab-476c-b545-4d295320baaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ce8b0544-f3ab-476c-b545-4d295320baaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:40.817389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:40.818556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:40.819518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 528/1080] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:40.825772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17847b-df66-44a0-8ab4-adfede03c5d4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:40.927256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17847b-df66-44a0-8ab4-adfede03c5d4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:40.947397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:40.962618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad741dc-3e51-4cd6-97e4-63f3ecf6b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:40.963637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad741dc-3e51-4cd6-97e4-63f3ecf6b7ff None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:40.963917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad741dc-3e51-4cd6-97e4-63f3ecf6b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:40.964189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad741dc-3e51-4cd6-97e4-63f3ecf6b7ff None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:40.964924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad741dc-3e51-4cd6-97e4-63f3ecf6b7ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:40.965230 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad741dc-3e51-4cd6-97e4-63f3ecf6b7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:40.966607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad741dc-3e51-4cd6-97e4-63f3ecf6b7ff None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:40.975583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 553/1081] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:40.981527 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b0544-f3ab-476c-b545-4d295320baaf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:41.082825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:41.087010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b0544-f3ab-476c-b545-4d295320baaf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:41.121717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59083a60-5988-442c-9e66-39a0139e0eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:41.122621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59083a60-5988-442c-9e66-39a0139e0eba None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:41.122898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59083a60-5988-442c-9e66-39a0139e0eba None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:41.123165 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59083a60-5988-442c-9e66-39a0139e0eba None admin] PATH_INFO: `/v3/users/2c6abc9ade924a71b2459a7f043dac72` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:41.124442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59083a60-5988-442c-9e66-39a0139e0eba None admin] RBAC: Authorizing `identity:get_user(user_id=2c6abc9ade924a71b2459a7f043dac72)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:41.125995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59083a60-5988-442c-9e66-39a0139e0eba None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:41.127613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 529/1082] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:00:40 2022] GET /identity/v3/users/2c6abc9ade924a71b2459a7f043dac72 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:41.134412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad741dc-3e51-4cd6-97e4-63f3ecf6b7ff None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:41.241084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad741dc-3e51-4cd6-97e4-63f3ecf6b7ff None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:41.275961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0830d59-1828-407c-a5bb-9ba7b78d4729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:41.276813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0830d59-1828-407c-a5bb-9ba7b78d4729 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:41.277084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0830d59-1828-407c-a5bb-9ba7b78d4729 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:41.277366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0830d59-1828-407c-a5bb-9ba7b78d4729 None admin] PATH_INFO: `/v3/projects/3210889c364f45239673981145f0c688` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:41.278584 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0830d59-1828-407c-a5bb-9ba7b78d4729 None admin] RBAC: Authorizing `identity:get_project(project_id=3210889c364f45239673981145f0c688)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:41.279997 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0830d59-1828-407c-a5bb-9ba7b78d4729 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:41.281921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 554/1083] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:00:41 2022] GET /identity/v3/projects/3210889c364f45239673981145f0c688 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:41.288140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59083a60-5988-442c-9e66-39a0139e0eba None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:41.396434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59083a60-5988-442c-9e66-39a0139e0eba None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:41.435086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a73f-8805-4669-a11d-8e48160f5cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:41.435985 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a73f-8805-4669-a11d-8e48160f5cb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:41.436265 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a73f-8805-4669-a11d-8e48160f5cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:41.436521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a73f-8805-4669-a11d-8e48160f5cb6 None admin] PATH_INFO: `/v3/projects/3210889c364f45239673981145f0c688/users/2c6abc9ade924a71b2459a7f043dac72/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:41.438560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856a73f-8805-4669-a11d-8e48160f5cb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3210889c364f45239673981145f0c688, user_id=2c6abc9ade924a71b2459a7f043dac72, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:41.440046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856a73f-8805-4669-a11d-8e48160f5cb6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:41.454745 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 530/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 15:00:41 2022] PUT /identity/v3/projects/3210889c364f45239673981145f0c688/users/2c6abc9ade924a71b2459a7f043dac72/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:00:42.765818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eafa3e-169a-48ea-9faf-31608d6b5b74 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:42.766464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eafa3e-169a-48ea-9faf-31608d6b5b74 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:42.766464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eafa3e-169a-48ea-9faf-31608d6b5b74 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:42.767853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 555/1085] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:42.773599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbb5c5-fd1e-4bf7-b0d8-4319f43409fd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:42.774029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbb5c5-fd1e-4bf7-b0d8-4319f43409fd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:42.774134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbb5c5-fd1e-4bf7-b0d8-4319f43409fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:42.794904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-10bbb5c5-fd1e-4bf7-b0d8-4319f43409fd None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:42.796099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-10bbb5c5-fd1e-4bf7-b0d8-4319f43409fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:42.817282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:42.865298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 531/1086] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:42.889239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eafa3e-169a-48ea-9faf-31608d6b5b74 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:42.943135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:42.998911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eafa3e-169a-48ea-9faf-31608d6b5b74 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:43.035088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58219a-ae2f-4eb9-9c70-676c1a67c1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:43.035821 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58219a-ae2f-4eb9-9c70-676c1a67c1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:43.036096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58219a-ae2f-4eb9-9c70-676c1a67c1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:43.036364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58219a-ae2f-4eb9-9c70-676c1a67c1a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:43.048449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58219a-ae2f-4eb9-9c70-676c1a67c1a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8e58219a-ae2f-4eb9-9c70-676c1a67c1a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:43.056848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:43.057961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:43.058904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 556/1087] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 17 15:00:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:43.064339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbb5c5-fd1e-4bf7-b0d8-4319f43409fd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:43.166992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbb5c5-fd1e-4bf7-b0d8-4319f43409fd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:43.203091 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679556-0375-463f-b296-da8d655b2837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:43.203756 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679556-0375-463f-b296-da8d655b2837 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:43.204032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679556-0375-463f-b296-da8d655b2837 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:43.204304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679556-0375-463f-b296-da8d655b2837 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:43.205045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68679556-0375-463f-b296-da8d655b2837 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:43.205384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68679556-0375-463f-b296-da8d655b2837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:43.206762 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68679556-0375-463f-b296-da8d655b2837 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:43.215254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 532/1088] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 17 15:00:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:43.221074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58219a-ae2f-4eb9-9c70-676c1a67c1a4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:43.326364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58219a-ae2f-4eb9-9c70-676c1a67c1a4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:43.336842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:43.362182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cbeb0-eb74-4eec-8f78-5025d71b8da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:43.362977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cbeb0-eb74-4eec-8f78-5025d71b8da6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:43.363259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cbeb0-eb74-4eec-8f78-5025d71b8da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:43.363531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cbeb0-eb74-4eec-8f78-5025d71b8da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:43.377227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cbeb0-eb74-4eec-8f78-5025d71b8da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:43.378703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cbeb0-eb74-4eec-8f78-5025d71b8da6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1f5cbeb0-eb74-4eec-8f78-5025d71b8da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:43.397673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:43.398616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:43.399826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:43.399826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:43.399826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:43.399826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:43.399826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 557/1089] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:00:43.405073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679556-0375-463f-b296-da8d655b2837 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:43.425423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:43.523169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679556-0375-463f-b296-da8d655b2837 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:43.549239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731d1e-475c-4487-b653-a480926987e6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:43.549527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731d1e-475c-4487-b653-a480926987e6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:43.549836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731d1e-475c-4487-b653-a480926987e6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:43.551188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 558/1090] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:43.556365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b6bea-1cc3-44a6-82b3-c7ad766df43e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:43.556651 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b6bea-1cc3-44a6-82b3-c7ad766df43e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:43.556928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b6bea-1cc3-44a6-82b3-c7ad766df43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:43.557375 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23de622-d3f1-4cb3-8d73-c1ed900c0492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:43.558042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23de622-d3f1-4cb3-8d73-c1ed900c0492 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:43.558319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23de622-d3f1-4cb3-8d73-c1ed900c0492 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:43.558593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23de622-d3f1-4cb3-8d73-c1ed900c0492 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:43.559315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23de622-d3f1-4cb3-8d73-c1ed900c0492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:43.559621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23de622-d3f1-4cb3-8d73-c1ed900c0492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:43.560993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23de622-d3f1-4cb3-8d73-c1ed900c0492 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:43.574321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 533/1091] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:43.574831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ed8b6bea-1cc3-44a6-82b3-c7ad766df43e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:43.575976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ed8b6bea-1cc3-44a6-82b3-c7ad766df43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:43.580638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23de622-d3f1-4cb3-8d73-c1ed900c0492 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:43.649062 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 559/1092] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:43.661846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:43.674674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b6bea-1cc3-44a6-82b3-c7ad766df43e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:43.687184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23de622-d3f1-4cb3-8d73-c1ed900c0492 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:43.725613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966d69a-39bd-4064-9e0b-6f6189f5f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:43.726508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966d69a-39bd-4064-9e0b-6f6189f5f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:43.726783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966d69a-39bd-4064-9e0b-6f6189f5f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:43.727102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966d69a-39bd-4064-9e0b-6f6189f5f1f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:43.734224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966d69a-39bd-4064-9e0b-6f6189f5f1f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:43.735670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966d69a-39bd-4064-9e0b-6f6189f5f1f6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8966d69a-39bd-4064-9e0b-6f6189f5f1f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:00:43.750759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:43.751778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:43.752729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 534/1093] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 17 15:00:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:43.758226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966d69a-39bd-4064-9e0b-6f6189f5f1f6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:43.771247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:43.781545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b6bea-1cc3-44a6-82b3-c7ad766df43e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:43.821750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1779b0f-fc6f-436c-8acf-2f608a9a7f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:43.822567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1779b0f-fc6f-436c-8acf-2f608a9a7f83 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:43.822850 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1779b0f-fc6f-436c-8acf-2f608a9a7f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:43.823126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1779b0f-fc6f-436c-8acf-2f608a9a7f83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:43.834141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1779b0f-fc6f-436c-8acf-2f608a9a7f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b1779b0f-fc6f-436c-8acf-2f608a9a7f83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:00:43.841783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:43.842725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:00:43.843683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 560/1094] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:00:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:43.848900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1779b0f-fc6f-436c-8acf-2f608a9a7f83 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:43.866321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966d69a-39bd-4064-9e0b-6f6189f5f1f6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:43.901838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02b7bf-631b-492e-ad97-31fd9b9764c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:43.902507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02b7bf-631b-492e-ad97-31fd9b9764c8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:43.902789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02b7bf-631b-492e-ad97-31fd9b9764c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:43.903061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02b7bf-631b-492e-ad97-31fd9b9764c8 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:43.903891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02b7bf-631b-492e-ad97-31fd9b9764c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:43.904219 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02b7bf-631b-492e-ad97-31fd9b9764c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:43.905691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02b7bf-631b-492e-ad97-31fd9b9764c8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:43.913632 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:43.923594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 535/1095] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 17 15:00:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:43.929503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02b7bf-631b-492e-ad97-31fd9b9764c8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:43.948577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1779b0f-fc6f-436c-8acf-2f608a9a7f83 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:43.983042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc6629-1d8c-41cb-9f85-c37a06a48cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:43.983688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc6629-1d8c-41cb-9f85-c37a06a48cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:43.983963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc6629-1d8c-41cb-9f85-c37a06a48cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:43.984231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc6629-1d8c-41cb-9f85-c37a06a48cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:43.984965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc6629-1d8c-41cb-9f85-c37a06a48cf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:43.985292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc6629-1d8c-41cb-9f85-c37a06a48cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:43.986725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc6629-1d8c-41cb-9f85-c37a06a48cf7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:43.995279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 561/1096] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:00:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:44.001784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc6629-1d8c-41cb-9f85-c37a06a48cf7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:44.017504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:44.031368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02b7bf-631b-492e-ad97-31fd9b9764c8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:44.065472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99ac57-75fa-4366-b9ae-c39774b7cbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:44.066107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99ac57-75fa-4366-b9ae-c39774b7cbfd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:44.066384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99ac57-75fa-4366-b9ae-c39774b7cbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:44.066655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99ac57-75fa-4366-b9ae-c39774b7cbfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:44.101368 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc6629-1d8c-41cb-9f85-c37a06a48cf7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:44.128635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:44.135474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99ac57-75fa-4366-b9ae-c39774b7cbfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:44.136012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fe224-aec9-43b1-994a-a322633a9852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:44.136877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fe224-aec9-43b1-994a-a322633a9852 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:44.136990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99ac57-75fa-4366-b9ae-c39774b7cbfd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:44.137153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fe224-aec9-43b1-994a-a322633a9852 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:44.137455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fe224-aec9-43b1-994a-a322633a9852 None admin] PATH_INFO: `/v3/users/2c6abc9ade924a71b2459a7f043dac72` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:44.138634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fe224-aec9-43b1-994a-a322633a9852 None admin] RBAC: Authorizing `identity:get_user(user_id=2c6abc9ade924a71b2459a7f043dac72)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:44.140032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fe224-aec9-43b1-994a-a322633a9852 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:44.141690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 562/1097] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:00:44 2022] GET /identity/v3/users/2c6abc9ade924a71b2459a7f043dac72 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:44.147721 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fe224-aec9-43b1-994a-a322633a9852 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:44.229652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:44.234711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 536/1098] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 15:00:44.240481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99ac57-75fa-4366-b9ae-c39774b7cbfd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:44.252043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fe224-aec9-43b1-994a-a322633a9852 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:44.285398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dae259-0ecb-4f08-99b3-5490f42e637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:44.286071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dae259-0ecb-4f08-99b3-5490f42e637b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:44.286346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dae259-0ecb-4f08-99b3-5490f42e637b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:44.286660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dae259-0ecb-4f08-99b3-5490f42e637b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:44.333905 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:44.340786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99ac57-75fa-4366-b9ae-c39774b7cbfd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:44.353796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dae259-0ecb-4f08-99b3-5490f42e637b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:44.355164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dae259-0ecb-4f08-99b3-5490f42e637b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:44.375182 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c78643-bb94-470c-87e3-09ffa7840f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:44.375986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c78643-bb94-470c-87e3-09ffa7840f4d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:44.376265 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c78643-bb94-470c-87e3-09ffa7840f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:44.376539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c78643-bb94-470c-87e3-09ffa7840f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:44.386879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c78643-bb94-470c-87e3-09ffa7840f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:44.388454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c78643-bb94-470c-87e3-09ffa7840f4d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-89c78643-bb94-470c-87e3-09ffa7840f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:00:44.412428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:44.414455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:44.416067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:00:44.416067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:00:44.416067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:00:44.416067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:44.416067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 537/1099] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:44.420701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c78643-bb94-470c-87e3-09ffa7840f4d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:44.450780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:44.470285 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 563/1100] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 15:00:44.476648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dae259-0ecb-4f08-99b3-5490f42e637b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:44.523765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c78643-bb94-470c-87e3-09ffa7840f4d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:44.559220 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da89a48-2938-4ced-b38c-466e6bef55b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:44.559874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da89a48-2938-4ced-b38c-466e6bef55b3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:44.560151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da89a48-2938-4ced-b38c-466e6bef55b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:44.560423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da89a48-2938-4ced-b38c-466e6bef55b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:44.561141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da89a48-2938-4ced-b38c-466e6bef55b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:44.561470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da89a48-2938-4ced-b38c-466e6bef55b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:44.562903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da89a48-2938-4ced-b38c-466e6bef55b3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:44.572529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dae259-0ecb-4f08-99b3-5490f42e637b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:44.575455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 538/1101] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:44.581000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da89a48-2938-4ced-b38c-466e6bef55b3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:44.592292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:44.607799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd3d16-5a2d-47ee-9f01-77450288ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:44.608592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd3d16-5a2d-47ee-9f01-77450288ade9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:44.608856 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd3d16-5a2d-47ee-9f01-77450288ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:44.609130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd3d16-5a2d-47ee-9f01-77450288ade9 None admin] PATH_INFO: `/v3/projects/3210889c364f45239673981145f0c688` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:44.610367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd3d16-5a2d-47ee-9f01-77450288ade9 None admin] RBAC: Authorizing `identity:get_project(project_id=3210889c364f45239673981145f0c688)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:44.611764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd3d16-5a2d-47ee-9f01-77450288ade9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:44.613519 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 564/1102] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:00:44 2022] GET /identity/v3/projects/3210889c364f45239673981145f0c688 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:44.619600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd3d16-5a2d-47ee-9f01-77450288ade9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:44.675391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:44.688328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da89a48-2938-4ced-b38c-466e6bef55b3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:44.727586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb07d8-9388-48bc-9114-6fa23f4d400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:44.728390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb07d8-9388-48bc-9114-6fa23f4d400c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:44.728673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb07d8-9388-48bc-9114-6fa23f4d400c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:44.728946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb07d8-9388-48bc-9114-6fa23f4d400c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:44.729367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd3d16-5a2d-47ee-9f01-77450288ade9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:44.736470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb07d8-9388-48bc-9114-6fa23f4d400c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:44.737963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb07d8-9388-48bc-9114-6fa23f4d400c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-79bb07d8-9388-48bc-9114-6fa23f4d400c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:00:44.752427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:00:44.753523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:00:44.754761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:00:44.754761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:00:44.754761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:00:44.754761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:00:44.754761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:00:44.754761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:00:44.754761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:00:44.754761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:00:44.754761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 539/1103] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:00:44.759495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb07d8-9388-48bc-9114-6fa23f4d400c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:44.767664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849df60f-0c62-4046-a881-db6ba9d44e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:44.768412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849df60f-0c62-4046-a881-db6ba9d44e15 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:44.768711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849df60f-0c62-4046-a881-db6ba9d44e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:44.768970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849df60f-0c62-4046-a881-db6ba9d44e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:44.769824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849df60f-0c62-4046-a881-db6ba9d44e15 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=3210889c364f45239673981145f0c688, user.id=2c6abc9ade924a71b2459a7f043dac72) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:44.770138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849df60f-0c62-4046-a881-db6ba9d44e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:44.771564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849df60f-0c62-4046-a881-db6ba9d44e15 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:44.793237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 565/1104] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:44 2022] GET /identity/v3/role_assignments?user.id=2c6abc9ade924a71b2459a7f043dac72&scope.project.id=3210889c364f45239673981145f0c688&role.id=8a6fe5045159487aa0119348cfe94387 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:00:44.845652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:44.885064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb07d8-9388-48bc-9114-6fa23f4d400c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:44.923899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86ed46-ccea-4125-b51f-b7b2c93d0635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:44.924697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86ed46-ccea-4125-b51f-b7b2c93d0635 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:44.925046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86ed46-ccea-4125-b51f-b7b2c93d0635 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:44.925451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86ed46-ccea-4125-b51f-b7b2c93d0635 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:44.926261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86ed46-ccea-4125-b51f-b7b2c93d0635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:44.926572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86ed46-ccea-4125-b51f-b7b2c93d0635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:44.928049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86ed46-ccea-4125-b51f-b7b2c93d0635 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:44.941700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 540/1105] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:44.948440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849df60f-0c62-4046-a881-db6ba9d44e15 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:45.050387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849df60f-0c62-4046-a881-db6ba9d44e15 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:45.064604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:45.087166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8635e3e-b15d-49ba-a9ff-b1eb973a9dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:45.087822 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8635e3e-b15d-49ba-a9ff-b1eb973a9dcb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:45.088100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8635e3e-b15d-49ba-a9ff-b1eb973a9dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:45.088371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8635e3e-b15d-49ba-a9ff-b1eb973a9dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:45.089192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8635e3e-b15d-49ba-a9ff-b1eb973a9dcb None admin] RBAC: Adding query filter params (role.id=9c81eb93ab264328b493f7e8b54e2611, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=ca11a9d339bb4e799dc4e5531147ddda) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:45.089529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8635e3e-b15d-49ba-a9ff-b1eb973a9dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:45.090955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8635e3e-b15d-49ba-a9ff-b1eb973a9dcb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:45.097091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 566/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:44 2022] GET /identity/v3/role_assignments?user.id=ca11a9d339bb4e799dc4e5531147ddda&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=9c81eb93ab264328b493f7e8b54e2611 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:46.969514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f9632-d848-4569-8d43-c6359384a9a9 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:46.970067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f9632-d848-4569-8d43-c6359384a9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:46.970067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f9632-d848-4569-8d43-c6359384a9a9 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:46.971421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 541/1107] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:46.977929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a541cc2-63b0-4350-9806-1f9ada121d94 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:46.978594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a541cc2-63b0-4350-9806-1f9ada121d94 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:46.978746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a541cc2-63b0-4350-9806-1f9ada121d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:47.006705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5a541cc2-63b0-4350-9806-1f9ada121d94 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:47.007924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5a541cc2-63b0-4350-9806-1f9ada121d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:47.081429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 567/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:47.106576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f9632-d848-4569-8d43-c6359384a9a9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:47.218810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f9632-d848-4569-8d43-c6359384a9a9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:47.247582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:47.258877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d132d3-85ce-47df-b34c-cdc292a0b093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:47.259673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d132d3-85ce-47df-b34c-cdc292a0b093 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:47.259961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d132d3-85ce-47df-b34c-cdc292a0b093 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:47.260239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d132d3-85ce-47df-b34c-cdc292a0b093 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:47.261534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d132d3-85ce-47df-b34c-cdc292a0b093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:47.262995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d132d3-85ce-47df-b34c-cdc292a0b093 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:47.264581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 542/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:47.271299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a541cc2-63b0-4350-9806-1f9ada121d94 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:47.379141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a541cc2-63b0-4350-9806-1f9ada121d94 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:47.389137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:47.419197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3a460-9d2b-4417-bc0e-2611789a6433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:47.419843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a460-9d2b-4417-bc0e-2611789a6433 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:47.420119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a460-9d2b-4417-bc0e-2611789a6433 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:47.420386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a460-9d2b-4417-bc0e-2611789a6433 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:47.421081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3a460-9d2b-4417-bc0e-2611789a6433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:47.422523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3a460-9d2b-4417-bc0e-2611789a6433 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:47.447750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 568/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 15:00:47 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:00:49.590343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132da05-d1f3-442c-8e35-9bb4b3a4550d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:49.590906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132da05-d1f3-442c-8e35-9bb4b3a4550d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:49.590906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132da05-d1f3-442c-8e35-9bb4b3a4550d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:49.592288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 543/1111] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:49.598395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e77bfa-a248-46a8-96c0-3e4d0ada9719 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:49.599168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e77bfa-a248-46a8-96c0-3e4d0ada9719 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:49.599366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e77bfa-a248-46a8-96c0-3e4d0ada9719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:49.623545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-74e77bfa-a248-46a8-96c0-3e4d0ada9719 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:49.624742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-74e77bfa-a248-46a8-96c0-3e4d0ada9719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:49.702541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 569/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:49.726621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132da05-d1f3-442c-8e35-9bb4b3a4550d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:49.845627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132da05-d1f3-442c-8e35-9bb4b3a4550d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:49.882649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10b863-8425-441c-8510-7d633d2a4507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:49.883505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10b863-8425-441c-8510-7d633d2a4507 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:49.883784 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10b863-8425-441c-8510-7d633d2a4507 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:49.884059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10b863-8425-441c-8510-7d633d2a4507 None admin] PATH_INFO: `/v3/roles/f36f89c30b0a4c38900202ea156ed20e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:49.885600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10b863-8425-441c-8510-7d633d2a4507 None admin] RBAC: Authorizing `identity:get_role(role_id=f36f89c30b0a4c38900202ea156ed20e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:49.886979 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10b863-8425-441c-8510-7d633d2a4507 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:49.888335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 544/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:00:49 2022] GET /identity/v3/roles/f36f89c30b0a4c38900202ea156ed20e => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:49.894965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e77bfa-a248-46a8-96c0-3e4d0ada9719 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:49.999299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:50.007508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e77bfa-a248-46a8-96c0-3e4d0ada9719 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:50.045623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016c72-5300-40db-8625-51056a00d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:50.046491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016c72-5300-40db-8625-51056a00d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:50.046767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016c72-5300-40db-8625-51056a00d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:50.047038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016c72-5300-40db-8625-51056a00d7d2 None admin] PATH_INFO: `/v3/users/de8a7183d7e6466c83831e5fc4c1c6ca` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:50.062846 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016c72-5300-40db-8625-51056a00d7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=de8a7183d7e6466c83831e5fc4c1c6ca)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:50.064292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016c72-5300-40db-8625-51056a00d7d2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:50.065993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 570/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:00:49 2022] GET /identity/v3/users/de8a7183d7e6466c83831e5fc4c1c6ca => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:50.072996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10b863-8425-441c-8510-7d633d2a4507 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:50.146242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:50.189606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10b863-8425-441c-8510-7d633d2a4507 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:50.228433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a929-5bbd-4859-9802-55bdb03d134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:50.229068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a929-5bbd-4859-9802-55bdb03d134d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:50.229373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a929-5bbd-4859-9802-55bdb03d134d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:50.229654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a929-5bbd-4859-9802-55bdb03d134d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:50.300973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8a929-5bbd-4859-9802-55bdb03d134d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:50.302467 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8a929-5bbd-4859-9802-55bdb03d134d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:50.366659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:50.407485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 545/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:00:50.414361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016c72-5300-40db-8625-51056a00d7d2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:50.529380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016c72-5300-40db-8625-51056a00d7d2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:50.567302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f4bce-d4fb-449e-aa35-076b0531a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:50.568165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f4bce-d4fb-449e-aa35-076b0531a995 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:50.568449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f4bce-d4fb-449e-aa35-076b0531a995 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:50.569101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f4bce-d4fb-449e-aa35-076b0531a995 None admin] PATH_INFO: `/v3/projects/3210889c364f45239673981145f0c688` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:50.570467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f4bce-d4fb-449e-aa35-076b0531a995 None admin] RBAC: Authorizing `identity:get_project(project_id=3210889c364f45239673981145f0c688)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:50.571910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f4bce-d4fb-449e-aa35-076b0531a995 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:50.573651 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 571/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:00:50 2022] GET /identity/v3/projects/3210889c364f45239673981145f0c688 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:50.580462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a929-5bbd-4859-9802-55bdb03d134d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:50.687116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a929-5bbd-4859-9802-55bdb03d134d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:50.724849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d25b3-3a7e-4c9d-9acc-5a9345d430e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:50.725589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d25b3-3a7e-4c9d-9acc-5a9345d430e2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:50.725868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d25b3-3a7e-4c9d-9acc-5a9345d430e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:50.726142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d25b3-3a7e-4c9d-9acc-5a9345d430e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:50.726977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d25b3-3a7e-4c9d-9acc-5a9345d430e2 None admin] RBAC: Adding query filter params (role.id=f36f89c30b0a4c38900202ea156ed20e, scope.project.id=3210889c364f45239673981145f0c688, user.id=de8a7183d7e6466c83831e5fc4c1c6ca) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:50.727295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d25b3-3a7e-4c9d-9acc-5a9345d430e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:50.728749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d25b3-3a7e-4c9d-9acc-5a9345d430e2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:50.734349 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 546/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:50 2022] GET /identity/v3/role_assignments?user.id=de8a7183d7e6466c83831e5fc4c1c6ca&scope.project.id=3210889c364f45239673981145f0c688&role.id=f36f89c30b0a4c38900202ea156ed20e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:52.852260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a8b02-347c-49de-8a2d-fc1b8ea67940 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:52.852791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a8b02-347c-49de-8a2d-fc1b8ea67940 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:52.852791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a8b02-347c-49de-8a2d-fc1b8ea67940 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:52.855001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 572/1118] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:52.863590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50864b0d-d977-4da3-9b7c-6f2682bf15f6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:52.863989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50864b0d-d977-4da3-9b7c-6f2682bf15f6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:52.864204 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50864b0d-d977-4da3-9b7c-6f2682bf15f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:52.888837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-50864b0d-d977-4da3-9b7c-6f2682bf15f6 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:52.890055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-50864b0d-d977-4da3-9b7c-6f2682bf15f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:52.915080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:52.962267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 547/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:52.985539 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a8b02-347c-49de-8a2d-fc1b8ea67940 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:53.012968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:53.102799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a8b02-347c-49de-8a2d-fc1b8ea67940 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:53.138244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bdb81-9437-42fd-809d-c03eef1f7995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:53.139081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bdb81-9437-42fd-809d-c03eef1f7995 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:53.139355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bdb81-9437-42fd-809d-c03eef1f7995 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:53.139624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bdb81-9437-42fd-809d-c03eef1f7995 None admin] PATH_INFO: `/v3/roles/f36f89c30b0a4c38900202ea156ed20e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:53.141117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bdb81-9437-42fd-809d-c03eef1f7995 None admin] RBAC: Authorizing `identity:get_role(role_id=f36f89c30b0a4c38900202ea156ed20e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:53.142521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bdb81-9437-42fd-809d-c03eef1f7995 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:53.143886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 573/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:00:52 2022] GET /identity/v3/roles/f36f89c30b0a4c38900202ea156ed20e => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:53.150423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50864b0d-d977-4da3-9b7c-6f2682bf15f6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:53.262288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50864b0d-d977-4da3-9b7c-6f2682bf15f6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:53.299471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fcf39-eae9-4756-a393-6565957b7079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:53.300367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fcf39-eae9-4756-a393-6565957b7079 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:53.300649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fcf39-eae9-4756-a393-6565957b7079 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:53.300925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fcf39-eae9-4756-a393-6565957b7079 None admin] PATH_INFO: `/v3/users/de8a7183d7e6466c83831e5fc4c1c6ca` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:53.302222 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fcf39-eae9-4756-a393-6565957b7079 None admin] RBAC: Authorizing `identity:get_user(user_id=de8a7183d7e6466c83831e5fc4c1c6ca)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:53.303983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fcf39-eae9-4756-a393-6565957b7079 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:53.305689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 548/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:00:53 2022] GET /identity/v3/users/de8a7183d7e6466c83831e5fc4c1c6ca => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:53.311693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bdb81-9437-42fd-809d-c03eef1f7995 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:53.414501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:53.432883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bdb81-9437-42fd-809d-c03eef1f7995 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:53.474426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982a37e-7ad1-4eb6-8383-74e1d1982475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:53.475461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982a37e-7ad1-4eb6-8383-74e1d1982475 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:53.475761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982a37e-7ad1-4eb6-8383-74e1d1982475 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:53.476095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982a37e-7ad1-4eb6-8383-74e1d1982475 None admin] PATH_INFO: `/v3/projects/3210889c364f45239673981145f0c688` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:53.477317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982a37e-7ad1-4eb6-8383-74e1d1982475 None admin] RBAC: Authorizing `identity:get_project(project_id=3210889c364f45239673981145f0c688)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:53.478730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982a37e-7ad1-4eb6-8383-74e1d1982475 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:53.480399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 574/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:00:53 2022] GET /identity/v3/projects/3210889c364f45239673981145f0c688 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:53.490131 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fcf39-eae9-4756-a393-6565957b7079 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:53.527869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:53.602954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fcf39-eae9-4756-a393-6565957b7079 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:53.638873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007f948-8c63-4481-8ca8-ea8c62e1397c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:53.639744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007f948-8c63-4481-8ca8-ea8c62e1397c None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:53.640014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007f948-8c63-4481-8ca8-ea8c62e1397c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:53.640289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007f948-8c63-4481-8ca8-ea8c62e1397c None admin] PATH_INFO: `/v3/projects/3210889c364f45239673981145f0c688/users/de8a7183d7e6466c83831e5fc4c1c6ca/roles/f36f89c30b0a4c38900202ea156ed20e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:53.642882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007f948-8c63-4481-8ca8-ea8c62e1397c None admin] RBAC: Authorizing `identity:create_grant(project_id=3210889c364f45239673981145f0c688, user_id=de8a7183d7e6466c83831e5fc4c1c6ca, role_id=f36f89c30b0a4c38900202ea156ed20e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:53.644314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007f948-8c63-4481-8ca8-ea8c62e1397c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:53.663932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 549/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 15:00:53 2022] PUT /identity/v3/projects/3210889c364f45239673981145f0c688/users/de8a7183d7e6466c83831e5fc4c1c6ca/roles/f36f89c30b0a4c38900202ea156ed20e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:00:55.783147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b235de1-fa54-468f-9e6a-710c244f3a8f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:55.783737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b235de1-fa54-468f-9e6a-710c244f3a8f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:55.783737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b235de1-fa54-468f-9e6a-710c244f3a8f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:55.785099 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 575/1124] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:00:55.790665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b787271-98af-4a2d-9b5b-1f4d74f1e8f3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:55.791072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b787271-98af-4a2d-9b5b-1f4d74f1e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:55.791206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b787271-98af-4a2d-9b5b-1f4d74f1e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:55.808249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4b787271-98af-4a2d-9b5b-1f4d74f1e8f3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:55.809469 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b787271-98af-4a2d-9b5b-1f4d74f1e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:55.878094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 550/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:55.902914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b235de1-fa54-468f-9e6a-710c244f3a8f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:56.023271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b235de1-fa54-468f-9e6a-710c244f3a8f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:56.057803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c1f41-f007-4946-8124-127094df93aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:56.058585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c1f41-f007-4946-8124-127094df93aa None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:56.058859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c1f41-f007-4946-8124-127094df93aa None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:56.059131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c1f41-f007-4946-8124-127094df93aa None admin] PATH_INFO: `/v3/roles/f36f89c30b0a4c38900202ea156ed20e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:56.060591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c1f41-f007-4946-8124-127094df93aa None admin] RBAC: Authorizing `identity:get_role(role_id=f36f89c30b0a4c38900202ea156ed20e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:56.061971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c1f41-f007-4946-8124-127094df93aa None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:56.063334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 576/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:00:55 2022] GET /identity/v3/roles/f36f89c30b0a4c38900202ea156ed20e => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:56.070465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b787271-98af-4a2d-9b5b-1f4d74f1e8f3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:56.096801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:56.196018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b787271-98af-4a2d-9b5b-1f4d74f1e8f3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:56.236082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08889fc5-6d08-486b-a85a-d94b2e0aef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:56.236952 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08889fc5-6d08-486b-a85a-d94b2e0aef85 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:56.237242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08889fc5-6d08-486b-a85a-d94b2e0aef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:56.237548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08889fc5-6d08-486b-a85a-d94b2e0aef85 None admin] PATH_INFO: `/v3/users/de8a7183d7e6466c83831e5fc4c1c6ca` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:56.238795 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08889fc5-6d08-486b-a85a-d94b2e0aef85 None admin] RBAC: Authorizing `identity:get_user(user_id=de8a7183d7e6466c83831e5fc4c1c6ca)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:56.240244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08889fc5-6d08-486b-a85a-d94b2e0aef85 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:56.242526 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 551/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:00:56 2022] GET /identity/v3/users/de8a7183d7e6466c83831e5fc4c1c6ca => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:56.251840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c1f41-f007-4946-8124-127094df93aa None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:56.288837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:56.373514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c1f41-f007-4946-8124-127094df93aa None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:56.408680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522ad8d-c551-4c36-a143-29903e4a88ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:56.409340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522ad8d-c551-4c36-a143-29903e4a88ef None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:56.409628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522ad8d-c551-4c36-a143-29903e4a88ef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:56.409897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522ad8d-c551-4c36-a143-29903e4a88ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:56.487344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522ad8d-c551-4c36-a143-29903e4a88ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:56.488785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522ad8d-c551-4c36-a143-29903e4a88ef None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:56.515270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:56.598863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 577/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:00:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:00:56.605443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08889fc5-6d08-486b-a85a-d94b2e0aef85 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:56.691891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:56.716569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08889fc5-6d08-486b-a85a-d94b2e0aef85 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:56.756874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15f228-077c-46fc-bdb9-795a5b17471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:56.757756 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f228-077c-46fc-bdb9-795a5b17471a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:56.758033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f228-077c-46fc-bdb9-795a5b17471a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:56.758305 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f228-077c-46fc-bdb9-795a5b17471a None admin] PATH_INFO: `/v3/projects/3210889c364f45239673981145f0c688` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:56.759623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15f228-077c-46fc-bdb9-795a5b17471a None admin] RBAC: Authorizing `identity:get_project(project_id=3210889c364f45239673981145f0c688)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:56.761059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15f228-077c-46fc-bdb9-795a5b17471a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:56.762774 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 552/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:00:56 2022] GET /identity/v3/projects/3210889c364f45239673981145f0c688 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:56.770270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522ad8d-c551-4c36-a143-29903e4a88ef None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:56.884512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522ad8d-c551-4c36-a143-29903e4a88ef None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:56.910140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:56.929318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c88282-b28d-417a-b4f0-d6c580407ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:56.929959 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c88282-b28d-417a-b4f0-d6c580407ddd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:56.930239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c88282-b28d-417a-b4f0-d6c580407ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:56.930510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c88282-b28d-417a-b4f0-d6c580407ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:56.931333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c88282-b28d-417a-b4f0-d6c580407ddd None admin] RBAC: Adding query filter params (role.id=f36f89c30b0a4c38900202ea156ed20e, scope.project.id=3210889c364f45239673981145f0c688, user.id=de8a7183d7e6466c83831e5fc4c1c6ca) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:00:56.931639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c88282-b28d-417a-b4f0-d6c580407ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:56.933066 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c88282-b28d-417a-b4f0-d6c580407ddd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:56.939020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 578/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:00:56 2022] GET /identity/v3/role_assignments?user.id=de8a7183d7e6466c83831e5fc4c1c6ca&scope.project.id=3210889c364f45239673981145f0c688&role.id=f36f89c30b0a4c38900202ea156ed20e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:59.053887 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad5068-e4a9-40c8-85d0-6cd0724ea2a3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:59.054416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad5068-e4a9-40c8-85d0-6cd0724ea2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:59.054416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad5068-e4a9-40c8-85d0-6cd0724ea2a3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:59.055698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 553/1131] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:00:59.061944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c82b6-5ba0-403c-8de1-a5a57760c720 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:59.062602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c82b6-5ba0-403c-8de1-a5a57760c720 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:59.062711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c82b6-5ba0-403c-8de1-a5a57760c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:59.089450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-315c82b6-5ba0-403c-8de1-a5a57760c720 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:00:59.090684 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-315c82b6-5ba0-403c-8de1-a5a57760c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:00:59.173912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 579/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:00:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:00:59.197771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad5068-e4a9-40c8-85d0-6cd0724ea2a3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:59.312657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad5068-e4a9-40c8-85d0-6cd0724ea2a3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:59.355371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba1d8e-bd88-44b6-a719-160ed2988b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:59.356519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba1d8e-bd88-44b6-a719-160ed2988b62 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:59.356997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba1d8e-bd88-44b6-a719-160ed2988b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:59.357425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba1d8e-bd88-44b6-a719-160ed2988b62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:59.359481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba1d8e-bd88-44b6-a719-160ed2988b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:59.361791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba1d8e-bd88-44b6-a719-160ed2988b62 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:59.364388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 554/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:00:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:00:59.370688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c82b6-5ba0-403c-8de1-a5a57760c720 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:00:59.525521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c82b6-5ba0-403c-8de1-a5a57760c720 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:00:59.555788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:00:59.577839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb4ab1-7aac-4183-955c-054090e19b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:00:59.578888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb4ab1-7aac-4183-955c-054090e19b47 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:00:59.579424 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb4ab1-7aac-4183-955c-054090e19b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:00:59.579927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb4ab1-7aac-4183-955c-054090e19b47 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:00:59.581261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb4ab1-7aac-4183-955c-054090e19b47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:00:59.583936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb4ab1-7aac-4183-955c-054090e19b47 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:00:59.616296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 580/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 15:00:59 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:01:01.787007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f72180-7d5c-45ca-936c-3998d3c83041 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:01.788214 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f72180-7d5c-45ca-936c-3998d3c83041 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:01.788214 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f72180-7d5c-45ca-936c-3998d3c83041 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:01.789101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 555/1135] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:01.794597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb97df-4a5d-4194-a392-e5d51694b419 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:01.795018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb97df-4a5d-4194-a392-e5d51694b419 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:01.795133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb97df-4a5d-4194-a392-e5d51694b419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:01.816012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fabb97df-4a5d-4194-a392-e5d51694b419 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:01.817830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fabb97df-4a5d-4194-a392-e5d51694b419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:01.888380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 581/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:01.913022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f72180-7d5c-45ca-936c-3998d3c83041 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:01.935201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:02.018572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f72180-7d5c-45ca-936c-3998d3c83041 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:02.053127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f35fa6-c637-4e9b-a98b-68eea1d70b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:02.053873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35fa6-c637-4e9b-a98b-68eea1d70b3e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:02.054150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35fa6-c637-4e9b-a98b-68eea1d70b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:02.054425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35fa6-c637-4e9b-a98b-68eea1d70b3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:02.055628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f35fa6-c637-4e9b-a98b-68eea1d70b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:02.057083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f35fa6-c637-4e9b-a98b-68eea1d70b3e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:02.058705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 556/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:01:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:02.064703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb97df-4a5d-4194-a392-e5d51694b419 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:02.172020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:02.175291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb97df-4a5d-4194-a392-e5d51694b419 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:02.213818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705a3da-111c-40d2-9eb8-83aaa2559f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:02.214481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705a3da-111c-40d2-9eb8-83aaa2559f4f None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:02.214766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705a3da-111c-40d2-9eb8-83aaa2559f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:02.215041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705a3da-111c-40d2-9eb8-83aaa2559f4f None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:02.215734 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705a3da-111c-40d2-9eb8-83aaa2559f4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:02.217167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705a3da-111c-40d2-9eb8-83aaa2559f4f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:02.237930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 582/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 15:01:02 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:01:04.415694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e3038-5791-45d2-a3af-d59c00c51b8a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:04.416257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e3038-5791-45d2-a3af-d59c00c51b8a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:04.416257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e3038-5791-45d2-a3af-d59c00c51b8a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:04.417642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 557/1139] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:04.423802 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3326c71-1817-4592-8471-d2651a1d1f79 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:04.424507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3326c71-1817-4592-8471-d2651a1d1f79 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:04.424653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3326c71-1817-4592-8471-d2651a1d1f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:04.446135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f3326c71-1817-4592-8471-d2651a1d1f79 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:04.447959 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f3326c71-1817-4592-8471-d2651a1d1f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:04.527380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 583/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:04.567120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e3038-5791-45d2-a3af-d59c00c51b8a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:04.676465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:04.691719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e3038-5791-45d2-a3af-d59c00c51b8a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:04.729875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb338ff-e2e8-43d4-95eb-a0787d4ed62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:04.730679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb338ff-e2e8-43d4-95eb-a0787d4ed62a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:04.730959 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb338ff-e2e8-43d4-95eb-a0787d4ed62a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:04.731236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb338ff-e2e8-43d4-95eb-a0787d4ed62a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:04.743227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb338ff-e2e8-43d4-95eb-a0787d4ed62a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9eb338ff-e2e8-43d4-95eb-a0787d4ed62a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:01:04.750853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:01:04.751977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:01:04.753826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 558/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:01:04.759858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3326c71-1817-4592-8471-d2651a1d1f79 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:04.853092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:04.869524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3326c71-1817-4592-8471-d2651a1d1f79 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:04.909462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b4a28-d691-4e9f-8deb-20f732ded4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:04.910195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b4a28-d691-4e9f-8deb-20f732ded4ce None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:04.910464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b4a28-d691-4e9f-8deb-20f732ded4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:04.910767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b4a28-d691-4e9f-8deb-20f732ded4ce None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:04.911730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b4a28-d691-4e9f-8deb-20f732ded4ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:04.912107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b4a28-d691-4e9f-8deb-20f732ded4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:04.913672 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b4a28-d691-4e9f-8deb-20f732ded4ce None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:04.922239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 584/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:01:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:04.928895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb338ff-e2e8-43d4-95eb-a0787d4ed62a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:05.049589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb338ff-e2e8-43d4-95eb-a0787d4ed62a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:05.085804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a96d6-c24f-4079-89cc-7afeca2cf72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:05.086665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a96d6-c24f-4079-89cc-7afeca2cf72a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:05.086937 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a96d6-c24f-4079-89cc-7afeca2cf72a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:05.087193 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a96d6-c24f-4079-89cc-7afeca2cf72a None admin] PATH_INFO: `/v3/users/beb682afe8354fb3a90c4848a8bda2b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:05.101159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a96d6-c24f-4079-89cc-7afeca2cf72a None admin] RBAC: Authorizing `identity:get_user(user_id=beb682afe8354fb3a90c4848a8bda2b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:05.102652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a96d6-c24f-4079-89cc-7afeca2cf72a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:05.104299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 559/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:01:04 2022] GET /identity/v3/users/beb682afe8354fb3a90c4848a8bda2b2 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:05.113538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b4a28-d691-4e9f-8deb-20f732ded4ce None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:05.226288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b4a28-d691-4e9f-8deb-20f732ded4ce None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:05.263141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0438f2-da3e-4ce9-8862-eff5378a9526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:05.263774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0438f2-da3e-4ce9-8862-eff5378a9526 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:05.264047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0438f2-da3e-4ce9-8862-eff5378a9526 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:05.264315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0438f2-da3e-4ce9-8862-eff5378a9526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:05.282757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:05.336200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0438f2-da3e-4ce9-8862-eff5378a9526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:05.337731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0438f2-da3e-4ce9-8862-eff5378a9526 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:05.443626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 585/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:01:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:01:05.450206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a96d6-c24f-4079-89cc-7afeca2cf72a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:05.460009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:05.562096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a96d6-c24f-4079-89cc-7afeca2cf72a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:05.603362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1440a4-da97-445e-be15-eba7fa5d65f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:05.604210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1440a4-da97-445e-be15-eba7fa5d65f9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:05.604481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1440a4-da97-445e-be15-eba7fa5d65f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:05.604751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1440a4-da97-445e-be15-eba7fa5d65f9 None admin] PATH_INFO: `/v3/projects/c8046956fedb49faa83d33f4e8baf6f9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:05.606039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1440a4-da97-445e-be15-eba7fa5d65f9 None admin] RBAC: Authorizing `identity:get_project(project_id=c8046956fedb49faa83d33f4e8baf6f9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:05.607565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1440a4-da97-445e-be15-eba7fa5d65f9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:05.609255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 560/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:01:05 2022] GET /identity/v3/projects/c8046956fedb49faa83d33f4e8baf6f9 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:05.616497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0438f2-da3e-4ce9-8862-eff5378a9526 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:05.673102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:05.731240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0438f2-da3e-4ce9-8862-eff5378a9526 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:05.772070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a239a7-5fed-49d4-a61f-53187eae0087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:05.772787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a239a7-5fed-49d4-a61f-53187eae0087 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:05.773191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a239a7-5fed-49d4-a61f-53187eae0087 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:05.773893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a239a7-5fed-49d4-a61f-53187eae0087 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:05.774791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a239a7-5fed-49d4-a61f-53187eae0087 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=c8046956fedb49faa83d33f4e8baf6f9, user.id=beb682afe8354fb3a90c4848a8bda2b2) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:05.775113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a239a7-5fed-49d4-a61f-53187eae0087 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:05.776523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a239a7-5fed-49d4-a61f-53187eae0087 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:05.782495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 586/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:01:05 2022] GET /identity/v3/role_assignments?user.id=beb682afe8354fb3a90c4848a8bda2b2&scope.project.id=c8046956fedb49faa83d33f4e8baf6f9&role.id=8a6fe5045159487aa0119348cfe94387 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:07.876881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3e37-8f3d-4c62-8e03-7f8d7eba07f2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:07.877842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3e37-8f3d-4c62-8e03-7f8d7eba07f2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:07.877842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3e37-8f3d-4c62-8e03-7f8d7eba07f2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:07.879998 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 561/1147] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:07.885486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f17fc-e532-4281-bac1-273c8cafbdf8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:07.885928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f17fc-e532-4281-bac1-273c8cafbdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:07.886018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f17fc-e532-4281-bac1-273c8cafbdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:07.905557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-188f17fc-e532-4281-bac1-273c8cafbdf8 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:07.906750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-188f17fc-e532-4281-bac1-273c8cafbdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:07.983065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 587/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:08.006454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e3e37-8f3d-4c62-8e03-7f8d7eba07f2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:08.097309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:08.128150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e3e37-8f3d-4c62-8e03-7f8d7eba07f2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:08.166351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1dd90-797e-433b-8866-5df402958984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:08.167145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1dd90-797e-433b-8866-5df402958984 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:08.167425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1dd90-797e-433b-8866-5df402958984 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:08.167703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1dd90-797e-433b-8866-5df402958984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:08.179332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1dd90-797e-433b-8866-5df402958984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-57d1dd90-797e-433b-8866-5df402958984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:01:08.186962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:01:08.188134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:01:08.189752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 562/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:01:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:01:08.198039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f17fc-e532-4281-bac1-273c8cafbdf8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:08.242348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:08.300452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f17fc-e532-4281-bac1-273c8cafbdf8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:08.337901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7bc90-8c25-4125-a735-36efac592f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:08.338562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7bc90-8c25-4125-a735-36efac592f24 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:08.338837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7bc90-8c25-4125-a735-36efac592f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:08.339111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7bc90-8c25-4125-a735-36efac592f24 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:08.339849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7bc90-8c25-4125-a735-36efac592f24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:08.340156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7bc90-8c25-4125-a735-36efac592f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:08.341548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7bc90-8c25-4125-a735-36efac592f24 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:08.349955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 588/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:01:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:01:08.356731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1dd90-797e-433b-8866-5df402958984 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:08.482752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1dd90-797e-433b-8866-5df402958984 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:08.518616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3ab48-8eea-4a87-9036-77f47bec7788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:08.519485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ab48-8eea-4a87-9036-77f47bec7788 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:08.519760 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ab48-8eea-4a87-9036-77f47bec7788 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:08.520030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ab48-8eea-4a87-9036-77f47bec7788 None admin] PATH_INFO: `/v3/users/beb682afe8354fb3a90c4848a8bda2b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:08.521328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3ab48-8eea-4a87-9036-77f47bec7788 None admin] RBAC: Authorizing `identity:get_user(user_id=beb682afe8354fb3a90c4848a8bda2b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:08.522763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3ab48-8eea-4a87-9036-77f47bec7788 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:08.524414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 563/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:01:08 2022] GET /identity/v3/users/beb682afe8354fb3a90c4848a8bda2b2 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:08.535008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7bc90-8c25-4125-a735-36efac592f24 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:08.646994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7bc90-8c25-4125-a735-36efac592f24 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:08.649674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:08.689882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb0f07-0e69-4faa-8ff7-12d9c05cc1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:08.690746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb0f07-0e69-4faa-8ff7-12d9c05cc1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:08.691026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb0f07-0e69-4faa-8ff7-12d9c05cc1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:08.691303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb0f07-0e69-4faa-8ff7-12d9c05cc1e5 None admin] PATH_INFO: `/v3/projects/c8046956fedb49faa83d33f4e8baf6f9` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:08.692531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb0f07-0e69-4faa-8ff7-12d9c05cc1e5 None admin] RBAC: Authorizing `identity:get_project(project_id=c8046956fedb49faa83d33f4e8baf6f9)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:08.694262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb0f07-0e69-4faa-8ff7-12d9c05cc1e5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:08.696092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 589/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:01:08 2022] GET /identity/v3/projects/c8046956fedb49faa83d33f4e8baf6f9 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:08.702989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3ab48-8eea-4a87-9036-77f47bec7788 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:08.706485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:08.819994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3ab48-8eea-4a87-9036-77f47bec7788 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:08.857550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf869d6-05f4-4966-a677-814b00f982fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:08.858436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf869d6-05f4-4966-a677-814b00f982fd None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:08.858716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf869d6-05f4-4966-a677-814b00f982fd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:08.858991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf869d6-05f4-4966-a677-814b00f982fd None admin] PATH_INFO: `/v3/projects/c8046956fedb49faa83d33f4e8baf6f9/users/beb682afe8354fb3a90c4848a8bda2b2/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:08.861171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf869d6-05f4-4966-a677-814b00f982fd None admin] RBAC: Authorizing `identity:create_grant(project_id=c8046956fedb49faa83d33f4e8baf6f9, user_id=beb682afe8354fb3a90c4848a8bda2b2, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:08.862649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf869d6-05f4-4966-a677-814b00f982fd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:08.882330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 564/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 15:01:08 2022] PUT /identity/v3/projects/c8046956fedb49faa83d33f4e8baf6f9/users/beb682afe8354fb3a90c4848a8bda2b2/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:01:10.997984 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4eae-1c37-4a1a-9e3b-510941b425ed None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:10.998562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4eae-1c37-4a1a-9e3b-510941b425ed None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:10.998562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4eae-1c37-4a1a-9e3b-510941b425ed None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:10.999886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 590/1154] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:11.008071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdca1f-b7bd-4bbb-b9a4-ea2807ec1e34 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:11.008519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdca1f-b7bd-4bbb-b9a4-ea2807ec1e34 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:11.008617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdca1f-b7bd-4bbb-b9a4-ea2807ec1e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:11.028215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ccfdca1f-b7bd-4bbb-b9a4-ea2807ec1e34 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:11.029439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ccfdca1f-b7bd-4bbb-b9a4-ea2807ec1e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:11.091262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:11.103862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 565/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:11.132266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e4eae-1c37-4a1a-9e3b-510941b425ed None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:11.254687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e4eae-1c37-4a1a-9e3b-510941b425ed None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:11.289754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce492b32-eeab-412e-891b-d7ff28e2a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:11.290554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce492b32-eeab-412e-891b-d7ff28e2a48b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:11.290827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce492b32-eeab-412e-891b-d7ff28e2a48b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:11.291102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce492b32-eeab-412e-891b-d7ff28e2a48b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:11.301714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce492b32-eeab-412e-891b-d7ff28e2a48b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ce492b32-eeab-412e-891b-d7ff28e2a48b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:01:11.309329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:01:11.310362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:01:11.311550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 591/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:01:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:01:11.316669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdca1f-b7bd-4bbb-b9a4-ea2807ec1e34 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:11.421016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdca1f-b7bd-4bbb-b9a4-ea2807ec1e34 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:11.462320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ad146-43c1-4515-95ec-3b22bde486f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:11.463465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ad146-43c1-4515-95ec-3b22bde486f0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:11.463962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ad146-43c1-4515-95ec-3b22bde486f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:11.464454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ad146-43c1-4515-95ec-3b22bde486f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:11.465929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ad146-43c1-4515-95ec-3b22bde486f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:11.466499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ad146-43c1-4515-95ec-3b22bde486f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:11.469084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ad146-43c1-4515-95ec-3b22bde486f0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:11.484664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 566/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:11.490870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce492b32-eeab-412e-891b-d7ff28e2a48b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:11.528476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:11.601937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce492b32-eeab-412e-891b-d7ff28e2a48b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:11.638918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b70c6-c427-4643-b7c8-083f8eef0066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:11.639861 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b70c6-c427-4643-b7c8-083f8eef0066 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:11.640141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b70c6-c427-4643-b7c8-083f8eef0066 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:11.640415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b70c6-c427-4643-b7c8-083f8eef0066 None admin] PATH_INFO: `/v3/users/beb682afe8354fb3a90c4848a8bda2b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:11.641675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b70c6-c427-4643-b7c8-083f8eef0066 None admin] RBAC: Authorizing `identity:get_user(user_id=beb682afe8354fb3a90c4848a8bda2b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:11.643184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b70c6-c427-4643-b7c8-083f8eef0066 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:11.644916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 592/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:01:11 2022] GET /identity/v3/users/beb682afe8354fb3a90c4848a8bda2b2 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:11.651249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ad146-43c1-4515-95ec-3b22bde486f0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:11.712135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:11.757761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ad146-43c1-4515-95ec-3b22bde486f0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:11.796734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1533fcb-cff3-49f7-b6bf-7c54a334aa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:11.797622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533fcb-cff3-49f7-b6bf-7c54a334aa14 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:11.797907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533fcb-cff3-49f7-b6bf-7c54a334aa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:11.798216 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533fcb-cff3-49f7-b6bf-7c54a334aa14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:11.872453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1533fcb-cff3-49f7-b6bf-7c54a334aa14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:11.873936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1533fcb-cff3-49f7-b6bf-7c54a334aa14 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:11.928009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:11.991470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 567/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:01:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:01:11.997735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b70c6-c427-4643-b7c8-083f8eef0066 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:12.102867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:12.107400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b70c6-c427-4643-b7c8-083f8eef0066 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:12.146797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80561858-4dad-4257-9b13-f741cb5d663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:12.147704 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561858-4dad-4257-9b13-f741cb5d663e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:12.147990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561858-4dad-4257-9b13-f741cb5d663e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:12.148299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561858-4dad-4257-9b13-f741cb5d663e None admin] PATH_INFO: `/v3/projects/c8046956fedb49faa83d33f4e8baf6f9` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:12.149632 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80561858-4dad-4257-9b13-f741cb5d663e None admin] RBAC: Authorizing `identity:get_project(project_id=c8046956fedb49faa83d33f4e8baf6f9)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:12.151084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80561858-4dad-4257-9b13-f741cb5d663e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:12.152818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 593/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:01:11 2022] GET /identity/v3/projects/c8046956fedb49faa83d33f4e8baf6f9 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:12.159737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1533fcb-cff3-49f7-b6bf-7c54a334aa14 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:12.262976 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1533fcb-cff3-49f7-b6bf-7c54a334aa14 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:12.303573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330a51c-9404-46ee-9cdf-2f25353b892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:12.304225 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330a51c-9404-46ee-9cdf-2f25353b892a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:12.304499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330a51c-9404-46ee-9cdf-2f25353b892a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:12.304771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330a51c-9404-46ee-9cdf-2f25353b892a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:12.305618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330a51c-9404-46ee-9cdf-2f25353b892a None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=c8046956fedb49faa83d33f4e8baf6f9, user.id=beb682afe8354fb3a90c4848a8bda2b2) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:12.305925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330a51c-9404-46ee-9cdf-2f25353b892a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:12.307363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330a51c-9404-46ee-9cdf-2f25353b892a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:12.313929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 568/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:01:12 2022] GET /identity/v3/role_assignments?user.id=beb682afe8354fb3a90c4848a8bda2b2&scope.project.id=c8046956fedb49faa83d33f4e8baf6f9&role.id=8a6fe5045159487aa0119348cfe94387 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:14.417590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e0af-b67c-4dfd-93ba-fa7c861fda67 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:14.418501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e0af-b67c-4dfd-93ba-fa7c861fda67 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:14.418501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e0af-b67c-4dfd-93ba-fa7c861fda67 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:14.420672 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 594/1162] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:14.426150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910fe37-5408-432b-9a4d-63fffcb8dfcb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:14.426570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910fe37-5408-432b-9a4d-63fffcb8dfcb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:14.426678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910fe37-5408-432b-9a4d-63fffcb8dfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:14.445084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a910fe37-5408-432b-9a4d-63fffcb8dfcb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:14.446273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a910fe37-5408-432b-9a4d-63fffcb8dfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:14.459914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:14.518573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 569/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:14.542636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670e0af-b67c-4dfd-93ba-fa7c861fda67 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:14.666881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670e0af-b67c-4dfd-93ba-fa7c861fda67 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:14.720636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457427c5-2083-4ce5-8db7-1c42744a27f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:14.721268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457427c5-2083-4ce5-8db7-1c42744a27f8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:14.721540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457427c5-2083-4ce5-8db7-1c42744a27f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:14.721797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457427c5-2083-4ce5-8db7-1c42744a27f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:14.761334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:14.808759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457427c5-2083-4ce5-8db7-1c42744a27f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:14.810390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457427c5-2083-4ce5-8db7-1c42744a27f8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:14.926152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 595/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:01:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:01:14.933519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910fe37-5408-432b-9a4d-63fffcb8dfcb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:15.047512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910fe37-5408-432b-9a4d-63fffcb8dfcb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:15.088667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f31c55-bd40-4029-9bdb-429f024a278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:15.089647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31c55-bd40-4029-9bdb-429f024a278b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:15.090027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31c55-bd40-4029-9bdb-429f024a278b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:15.090325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31c55-bd40-4029-9bdb-429f024a278b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:15.098122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f31c55-bd40-4029-9bdb-429f024a278b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:15.099739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f31c55-bd40-4029-9bdb-429f024a278b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-20f31c55-bd40-4029-9bdb-429f024a278b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:01:15.116466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:01:15.117838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:01:15.118754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 570/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 17 15:01:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:01:15.124967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457427c5-2083-4ce5-8db7-1c42744a27f8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:15.199926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:15.235797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457427c5-2083-4ce5-8db7-1c42744a27f8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:15.273011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4f104-c35d-4edc-bd94-52e42de220f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:15.273709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4f104-c35d-4edc-bd94-52e42de220f5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:15.273992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4f104-c35d-4edc-bd94-52e42de220f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:15.274264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4f104-c35d-4edc-bd94-52e42de220f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:15.274981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4f104-c35d-4edc-bd94-52e42de220f5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:15.275283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4f104-c35d-4edc-bd94-52e42de220f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:15.276654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4f104-c35d-4edc-bd94-52e42de220f5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:15.284400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 596/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 17 15:01:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:17.380914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e4df-5868-4122-83dc-7dda0c603fa8 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:17.381849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e4df-5868-4122-83dc-7dda0c603fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:17.381849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e4df-5868-4122-83dc-7dda0c603fa8 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:17.383188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 571/1167] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:17.390784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4f5f1-e9ee-4b30-8bf6-ad4a2d1c56be None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:17.391321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4f5f1-e9ee-4b30-8bf6-ad4a2d1c56be None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:17.391415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4f5f1-e9ee-4b30-8bf6-ad4a2d1c56be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:17.416195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a5b4f5f1-e9ee-4b30-8bf6-ad4a2d1c56be None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:17.417459 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a5b4f5f1-e9ee-4b30-8bf6-ad4a2d1c56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:17.491092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 597/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:17.520241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926e4df-5868-4122-83dc-7dda0c603fa8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:17.532854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:17.647827 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926e4df-5868-4122-83dc-7dda0c603fa8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:17.686058 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a53a6-f958-4f47-9c8f-26982f8a5280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:17.686709 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a53a6-f958-4f47-9c8f-26982f8a5280 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:17.686989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a53a6-f958-4f47-9c8f-26982f8a5280 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:17.687269 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a53a6-f958-4f47-9c8f-26982f8a5280 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:17.688025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a53a6-f958-4f47-9c8f-26982f8a5280 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:17.689451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a53a6-f958-4f47-9c8f-26982f8a5280 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:17.707419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 572/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Fri Jun 17 15:01:17 2022] POST /identity/v3/domains => generated 267 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:01:19.841405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8dfe0-c7f1-41fc-8a04-8f1ee9b0e90e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:19.841940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8dfe0-c7f1-41fc-8a04-8f1ee9b0e90e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:19.841940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8dfe0-c7f1-41fc-8a04-8f1ee9b0e90e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:19.843237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 598/1170] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:19.849574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d592bc9-3159-4737-aece-da8319082425 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:19.850305 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d592bc9-3159-4737-aece-da8319082425 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:19.850441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d592bc9-3159-4737-aece-da8319082425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:19.870646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3d592bc9-3159-4737-aece-da8319082425 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:19.871854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3d592bc9-3159-4737-aece-da8319082425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:19.940637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:19.947599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 573/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:19.982306 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8dfe0-c7f1-41fc-8a04-8f1ee9b0e90e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:20.057247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:20.105774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8dfe0-c7f1-41fc-8a04-8f1ee9b0e90e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:20.139203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ea61c-95ea-4113-8e7a-2179d4005718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:20.140062 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ea61c-95ea-4113-8e7a-2179d4005718 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:20.140336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ea61c-95ea-4113-8e7a-2179d4005718 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:20.140602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ea61c-95ea-4113-8e7a-2179d4005718 None admin] PATH_INFO: `/v3/domains/1b440e48966d40d98396265ff6b60a0e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:20.154485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ea61c-95ea-4113-8e7a-2179d4005718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1b440e48966d40d98396265ff6b60a0e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:20.156040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ea61c-95ea-4113-8e7a-2179d4005718 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:20.157761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 599/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Fri Jun 17 15:01:19 2022] GET /identity/v3/domains/1b440e48966d40d98396265ff6b60a0e => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:20.164544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d592bc9-3159-4737-aece-da8319082425 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:20.273175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d592bc9-3159-4737-aece-da8319082425 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:20.308478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd64bd-1a59-4cb7-a9b0-2c336c2c0513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:20.309057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd64bd-1a59-4cb7-a9b0-2c336c2c0513 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:20.309364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd64bd-1a59-4cb7-a9b0-2c336c2c0513 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:20.309636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd64bd-1a59-4cb7-a9b0-2c336c2c0513 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:20.310376 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd64bd-1a59-4cb7-a9b0-2c336c2c0513 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:20.311857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd64bd-1a59-4cb7-a9b0-2c336c2c0513 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:20.344301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 574/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 15:01:20 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:01:22.551790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4716be-7aa3-4726-8ac6-e04d0fc0155e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:22.552386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4716be-7aa3-4726-8ac6-e04d0fc0155e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:22.552386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4716be-7aa3-4726-8ac6-e04d0fc0155e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:22.553787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 600/1174] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:22.559505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1c6f2-566a-4dea-bc5d-aa72e90c4aab None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:22.559956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1c6f2-566a-4dea-bc5d-aa72e90c4aab None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:22.560049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1c6f2-566a-4dea-bc5d-aa72e90c4aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:22.578140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-aab1c6f2-566a-4dea-bc5d-aa72e90c4aab None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:22.579338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aab1c6f2-566a-4dea-bc5d-aa72e90c4aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:22.628426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:22.656106 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 575/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:22.682560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4716be-7aa3-4726-8ac6-e04d0fc0155e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:22.795915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4716be-7aa3-4726-8ac6-e04d0fc0155e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:22.822734 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:22.836885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c0180-0c83-470a-8580-16729fb5cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:22.837881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c0180-0c83-470a-8580-16729fb5cde1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:22.838147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c0180-0c83-470a-8580-16729fb5cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:22.838420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c0180-0c83-470a-8580-16729fb5cde1 None admin] PATH_INFO: `/v3/domains/1b440e48966d40d98396265ff6b60a0e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:22.839644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c0180-0c83-470a-8580-16729fb5cde1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1b440e48966d40d98396265ff6b60a0e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:22.841084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c0180-0c83-470a-8580-16729fb5cde1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:22.842781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 601/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Fri Jun 17 15:01:22 2022] GET /identity/v3/domains/1b440e48966d40d98396265ff6b60a0e => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:22.849032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1c6f2-566a-4dea-bc5d-aa72e90c4aab None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:22.968725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1c6f2-566a-4dea-bc5d-aa72e90c4aab None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:23.003743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf85272-709f-4b41-bc6d-f43aae3bc82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:23.004402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf85272-709f-4b41-bc6d-f43aae3bc82a None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:23.004689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf85272-709f-4b41-bc6d-f43aae3bc82a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:23.004951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf85272-709f-4b41-bc6d-f43aae3bc82a None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:23.005742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf85272-709f-4b41-bc6d-f43aae3bc82a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:23.007339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf85272-709f-4b41-bc6d-f43aae3bc82a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:23.033073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 576/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 15:01:22 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:01:25.175251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ef68f-fd93-49f3-970f-9d38130ccb70 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:25.176146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ef68f-fd93-49f3-970f-9d38130ccb70 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:25.176146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ef68f-fd93-49f3-970f-9d38130ccb70 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:25.178564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 602/1178] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:25.187277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd54d60-9e15-4351-a6cf-e0dee87bb17e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:25.187686 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd54d60-9e15-4351-a6cf-e0dee87bb17e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:25.187840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd54d60-9e15-4351-a6cf-e0dee87bb17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:25.210308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bbd54d60-9e15-4351-a6cf-e0dee87bb17e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:25.211671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bbd54d60-9e15-4351-a6cf-e0dee87bb17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:25.249705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:25.299865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 577/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:25.336130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ef68f-fd93-49f3-970f-9d38130ccb70 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:25.442945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ef68f-fd93-49f3-970f-9d38130ccb70 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:25.479118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1197ca-f455-4d41-a226-aec0137ac397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:25.479963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1197ca-f455-4d41-a226-aec0137ac397 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:25.480241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1197ca-f455-4d41-a226-aec0137ac397 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:25.480507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1197ca-f455-4d41-a226-aec0137ac397 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:25.491707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1197ca-f455-4d41-a226-aec0137ac397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-aa1197ca-f455-4d41-a226-aec0137ac397 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:01:25.499207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:01:25.500276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:01:25.501303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 603/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:01:25.508855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd54d60-9e15-4351-a6cf-e0dee87bb17e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:25.613232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd54d60-9e15-4351-a6cf-e0dee87bb17e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:25.647955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeddea7-0f32-4e7b-8471-5f01ea3bc88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:25.648621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeddea7-0f32-4e7b-8471-5f01ea3bc88d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:25.648908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeddea7-0f32-4e7b-8471-5f01ea3bc88d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:25.649229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeddea7-0f32-4e7b-8471-5f01ea3bc88d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:25.649978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeddea7-0f32-4e7b-8471-5f01ea3bc88d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:25.650285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeddea7-0f32-4e7b-8471-5f01ea3bc88d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:25.651665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeddea7-0f32-4e7b-8471-5f01ea3bc88d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:25.660091 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 578/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:25.666906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1197ca-f455-4d41-a226-aec0137ac397 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:25.727214 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:25.778932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1197ca-f455-4d41-a226-aec0137ac397 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:25.813638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d7987-8e0a-4161-b56a-778f2ee1c0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:25.814506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d7987-8e0a-4161-b56a-778f2ee1c0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:25.814778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d7987-8e0a-4161-b56a-778f2ee1c0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:25.815046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d7987-8e0a-4161-b56a-778f2ee1c0b8 None admin] PATH_INFO: `/v3/users/7d10f627e76c46cfbddf9d587cdf297f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:25.828842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d7987-8e0a-4161-b56a-778f2ee1c0b8 None admin] RBAC: Authorizing `identity:get_user(user_id=7d10f627e76c46cfbddf9d587cdf297f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:25.830325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d7987-8e0a-4161-b56a-778f2ee1c0b8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:25.831963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 604/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:01:25 2022] GET /identity/v3/users/7d10f627e76c46cfbddf9d587cdf297f => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:25.838110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeddea7-0f32-4e7b-8471-5f01ea3bc88d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:25.871802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:25.952542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeddea7-0f32-4e7b-8471-5f01ea3bc88d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:25.987971 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ce31b-6440-4c81-a711-ce5f7c70628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:25.988608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ce31b-6440-4c81-a711-ce5f7c70628a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:25.988891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ce31b-6440-4c81-a711-ce5f7c70628a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:25.989160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ce31b-6440-4c81-a711-ce5f7c70628a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:26.063019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ce31b-6440-4c81-a711-ce5f7c70628a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:26.064657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ce31b-6440-4c81-a711-ce5f7c70628a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:26.095661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:26.173611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 579/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:01:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:01:26.179820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d7987-8e0a-4161-b56a-778f2ee1c0b8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:26.294954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d7987-8e0a-4161-b56a-778f2ee1c0b8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:26.304319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:26.332414 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff4d93-d84b-4a90-8934-59fe37499d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:26.333295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff4d93-d84b-4a90-8934-59fe37499d9c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:26.333577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff4d93-d84b-4a90-8934-59fe37499d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:26.333849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff4d93-d84b-4a90-8934-59fe37499d9c None admin] PATH_INFO: `/v3/projects/cfcfb983e7184b5b93d4d13da65268d0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:26.335162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff4d93-d84b-4a90-8934-59fe37499d9c None admin] RBAC: Authorizing `identity:get_project(project_id=cfcfb983e7184b5b93d4d13da65268d0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:26.336588 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff4d93-d84b-4a90-8934-59fe37499d9c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:26.338301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 605/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:01:26 2022] GET /identity/v3/projects/cfcfb983e7184b5b93d4d13da65268d0 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:26.344705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ce31b-6440-4c81-a711-ce5f7c70628a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:26.450660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ce31b-6440-4c81-a711-ce5f7c70628a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:26.477535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:26.486670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bef2c-2ea9-4315-95eb-589cde9a54f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:26.487321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bef2c-2ea9-4315-95eb-589cde9a54f2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:26.487602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bef2c-2ea9-4315-95eb-589cde9a54f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:26.487879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bef2c-2ea9-4315-95eb-589cde9a54f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:26.488706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bef2c-2ea9-4315-95eb-589cde9a54f2 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=cfcfb983e7184b5b93d4d13da65268d0, user.id=7d10f627e76c46cfbddf9d587cdf297f) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:26.489014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bef2c-2ea9-4315-95eb-589cde9a54f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:26.490486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bef2c-2ea9-4315-95eb-589cde9a54f2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:26.496371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 580/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:01:26 2022] GET /identity/v3/role_assignments?user.id=7d10f627e76c46cfbddf9d587cdf297f&scope.project.id=cfcfb983e7184b5b93d4d13da65268d0&role.id=8a6fe5045159487aa0119348cfe94387 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:28.576935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9728-4674-4f32-91c8-d5fbb0d6a44a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:28.577549 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9728-4674-4f32-91c8-d5fbb0d6a44a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:28.577549 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9728-4674-4f32-91c8-d5fbb0d6a44a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:28.578897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 606/1186] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:28.585330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c828d4-a3c4-4520-9062-9d37aea68298 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:28.585796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c828d4-a3c4-4520-9062-9d37aea68298 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:28.585896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c828d4-a3c4-4520-9062-9d37aea68298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:28.605025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a2c828d4-a3c4-4520-9062-9d37aea68298 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:28.606250 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a2c828d4-a3c4-4520-9062-9d37aea68298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:28.682918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 581/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:28.710814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f9728-4674-4f32-91c8-d5fbb0d6a44a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:28.826739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f9728-4674-4f32-91c8-d5fbb0d6a44a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:28.866032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23093f54-4e14-47e7-9457-d58be432249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:28.866707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23093f54-4e14-47e7-9457-d58be432249a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:28.866988 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23093f54-4e14-47e7-9457-d58be432249a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:28.867265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23093f54-4e14-47e7-9457-d58be432249a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:28.878418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23093f54-4e14-47e7-9457-d58be432249a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-23093f54-4e14-47e7-9457-d58be432249a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:01:28.886137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:01:28.887208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:01:28.888101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 607/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:01:28.894031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c828d4-a3c4-4520-9062-9d37aea68298 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:29.000218 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c828d4-a3c4-4520-9062-9d37aea68298 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:29.024088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:29.035886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558d2b0-cc5b-4090-8411-77874c1e8a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:29.036551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558d2b0-cc5b-4090-8411-77874c1e8a45 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:29.036831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558d2b0-cc5b-4090-8411-77874c1e8a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:29.037106 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558d2b0-cc5b-4090-8411-77874c1e8a45 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:29.037939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558d2b0-cc5b-4090-8411-77874c1e8a45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:29.038246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558d2b0-cc5b-4090-8411-77874c1e8a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:29.039620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558d2b0-cc5b-4090-8411-77874c1e8a45 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:29.047863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 582/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:01:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:29.055110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23093f54-4e14-47e7-9457-d58be432249a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:29.105707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:29.179504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23093f54-4e14-47e7-9457-d58be432249a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:29.214979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b406e00-ad79-419c-8a45-5025b1b9dc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:29.215838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b406e00-ad79-419c-8a45-5025b1b9dc56 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:29.216116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b406e00-ad79-419c-8a45-5025b1b9dc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:29.216385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b406e00-ad79-419c-8a45-5025b1b9dc56 None admin] PATH_INFO: `/v3/users/7d10f627e76c46cfbddf9d587cdf297f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:29.217712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b406e00-ad79-419c-8a45-5025b1b9dc56 None admin] RBAC: Authorizing `identity:get_user(user_id=7d10f627e76c46cfbddf9d587cdf297f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:29.219130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b406e00-ad79-419c-8a45-5025b1b9dc56 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:29.220739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 608/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:01:29 2022] GET /identity/v3/users/7d10f627e76c46cfbddf9d587cdf297f => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:29.227174 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558d2b0-cc5b-4090-8411-77874c1e8a45 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:29.332664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558d2b0-cc5b-4090-8411-77874c1e8a45 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:29.367050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c197ebb-3cbb-45ed-a873-d5542b6dbb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:29.367893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197ebb-3cbb-45ed-a873-d5542b6dbb19 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:29.368170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197ebb-3cbb-45ed-a873-d5542b6dbb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:29.368442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197ebb-3cbb-45ed-a873-d5542b6dbb19 None admin] PATH_INFO: `/v3/projects/cfcfb983e7184b5b93d4d13da65268d0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:29.369731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c197ebb-3cbb-45ed-a873-d5542b6dbb19 None admin] RBAC: Authorizing `identity:get_project(project_id=cfcfb983e7184b5b93d4d13da65268d0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:29.371189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c197ebb-3cbb-45ed-a873-d5542b6dbb19 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:29.372879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 583/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:01:29 2022] GET /identity/v3/projects/cfcfb983e7184b5b93d4d13da65268d0 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:29.379254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b406e00-ad79-419c-8a45-5025b1b9dc56 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:29.481710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b406e00-ad79-419c-8a45-5025b1b9dc56 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:29.483984 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:29.519247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab2a23-b367-46bd-93e0-237c3e4936e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:29.520108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab2a23-b367-46bd-93e0-237c3e4936e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:29.520381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab2a23-b367-46bd-93e0-237c3e4936e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:29.520653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab2a23-b367-46bd-93e0-237c3e4936e5 None admin] PATH_INFO: `/v3/projects/cfcfb983e7184b5b93d4d13da65268d0/users/7d10f627e76c46cfbddf9d587cdf297f/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:29.522674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab2a23-b367-46bd-93e0-237c3e4936e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfcfb983e7184b5b93d4d13da65268d0, user_id=7d10f627e76c46cfbddf9d587cdf297f, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:29.524166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab2a23-b367-46bd-93e0-237c3e4936e5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:29.537796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 609/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 15:01:29 2022] PUT /identity/v3/projects/cfcfb983e7184b5b93d4d13da65268d0/users/7d10f627e76c46cfbddf9d587cdf297f/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:01:31.641158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677ac31-8b16-4ed6-a812-80e8702358df None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:31.642099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677ac31-8b16-4ed6-a812-80e8702358df None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:31.642099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677ac31-8b16-4ed6-a812-80e8702358df None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:31.644314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 584/1193] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:01:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:01:31.650684 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d142b4-9c24-4de0-b226-8e6a56b03701 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:31.651135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d142b4-9c24-4de0-b226-8e6a56b03701 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:31.651278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d142b4-9c24-4de0-b226-8e6a56b03701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:31.674203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a1d142b4-9c24-4de0-b226-8e6a56b03701 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:01:31.675405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a1d142b4-9c24-4de0-b226-8e6a56b03701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:01:31.750286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 610/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:01:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:01:31.774791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677ac31-8b16-4ed6-a812-80e8702358df None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:31.834559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:31.894100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677ac31-8b16-4ed6-a812-80e8702358df None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:31.932834 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f718-412f-441e-88ce-91dc4d0ff7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:31.933723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f718-412f-441e-88ce-91dc4d0ff7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:31.933994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f718-412f-441e-88ce-91dc4d0ff7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:31.934255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f718-412f-441e-88ce-91dc4d0ff7e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:31.945242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557f718-412f-441e-88ce-91dc4d0ff7e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7557f718-412f-441e-88ce-91dc4d0ff7e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:01:31.953176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:01:31.954388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:01:31.955538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 585/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:01:31.961552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d142b4-9c24-4de0-b226-8e6a56b03701 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:32.059545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:32.067079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d142b4-9c24-4de0-b226-8e6a56b03701 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:32.103067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc72de-8e9c-45f2-a0f9-49d9cfaf4331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:32.103711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc72de-8e9c-45f2-a0f9-49d9cfaf4331 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:32.103994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc72de-8e9c-45f2-a0f9-49d9cfaf4331 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:32.104274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc72de-8e9c-45f2-a0f9-49d9cfaf4331 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:32.105018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc72de-8e9c-45f2-a0f9-49d9cfaf4331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:32.105359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc72de-8e9c-45f2-a0f9-49d9cfaf4331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:32.106735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc72de-8e9c-45f2-a0f9-49d9cfaf4331 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:32.115269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 611/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:32.121751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f718-412f-441e-88ce-91dc4d0ff7e8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:32.227463 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f718-412f-441e-88ce-91dc4d0ff7e8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:32.240154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:32.264359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2112-de53-466a-9cb6-481fe4a5b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:32.265337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2112-de53-466a-9cb6-481fe4a5b95f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:32.265613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2112-de53-466a-9cb6-481fe4a5b95f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:32.265892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2112-de53-466a-9cb6-481fe4a5b95f None admin] PATH_INFO: `/v3/users/7d10f627e76c46cfbddf9d587cdf297f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:32.267099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a2112-de53-466a-9cb6-481fe4a5b95f None admin] RBAC: Authorizing `identity:get_user(user_id=7d10f627e76c46cfbddf9d587cdf297f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:32.268631 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a2112-de53-466a-9cb6-481fe4a5b95f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:32.270280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 586/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 17 15:01:32 2022] GET /identity/v3/users/7d10f627e76c46cfbddf9d587cdf297f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:32.276537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc72de-8e9c-45f2-a0f9-49d9cfaf4331 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:32.381289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc72de-8e9c-45f2-a0f9-49d9cfaf4331 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:32.415619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f949c9-9766-4fb5-b364-a776fb63de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:32.416253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f949c9-9766-4fb5-b364-a776fb63de9f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:32.416527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f949c9-9766-4fb5-b364-a776fb63de9f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:32.416763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f949c9-9766-4fb5-b364-a776fb63de9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:32.441660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:32.486216 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f949c9-9766-4fb5-b364-a776fb63de9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:32.487585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f949c9-9766-4fb5-b364-a776fb63de9f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:32.594557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 612/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:01:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:01:32.601050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2112-de53-466a-9cb6-481fe4a5b95f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:32.709638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2112-de53-466a-9cb6-481fe4a5b95f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:32.745639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce42a49-bef9-43b2-a793-51e76ac0c417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:32.746495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce42a49-bef9-43b2-a793-51e76ac0c417 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:32.746771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce42a49-bef9-43b2-a793-51e76ac0c417 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:32.747042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce42a49-bef9-43b2-a793-51e76ac0c417 None admin] PATH_INFO: `/v3/projects/cfcfb983e7184b5b93d4d13da65268d0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:32.748214 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce42a49-bef9-43b2-a793-51e76ac0c417 None admin] RBAC: Authorizing `identity:get_project(project_id=cfcfb983e7184b5b93d4d13da65268d0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:32.749691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce42a49-bef9-43b2-a793-51e76ac0c417 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:32.751372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 587/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 17 15:01:32 2022] GET /identity/v3/projects/cfcfb983e7184b5b93d4d13da65268d0 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:01:32.758007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f949c9-9766-4fb5-b364-a776fb63de9f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:01:32.819268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:32.879729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f949c9-9766-4fb5-b364-a776fb63de9f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:01:32.918166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf500b9-0f89-4d42-9851-0cc25b510975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:01:32.918812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf500b9-0f89-4d42-9851-0cc25b510975 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:01:32.919091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf500b9-0f89-4d42-9851-0cc25b510975 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:01:32.919365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf500b9-0f89-4d42-9851-0cc25b510975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:01:32.920188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf500b9-0f89-4d42-9851-0cc25b510975 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=cfcfb983e7184b5b93d4d13da65268d0, user.id=7d10f627e76c46cfbddf9d587cdf297f) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:01:32.920501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf500b9-0f89-4d42-9851-0cc25b510975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:01:32.921961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf500b9-0f89-4d42-9851-0cc25b510975 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:01:32.927907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 613/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:01:32 2022] GET /identity/v3/role_assignments?user.id=7d10f627e76c46cfbddf9d587cdf297f&scope.project.id=cfcfb983e7184b5b93d4d13da65268d0&role.id=8a6fe5045159487aa0119348cfe94387 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:01:42.740509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=76 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:01:42.925164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=40 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:31.453261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45262672-f069-49d7-a026-f065a0f06652 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:31.453261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45262672-f069-49d7-a026-f065a0f06652 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:31.453261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45262672-f069-49d7-a026-f065a0f06652 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:31.454992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 588/1201] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:02:31.463629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373beaff-185c-4181-9164-894cac5e848d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:31.464208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373beaff-185c-4181-9164-894cac5e848d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:31.464208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373beaff-185c-4181-9164-894cac5e848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:31.485980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-373beaff-185c-4181-9164-894cac5e848d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:02:31.490559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-373beaff-185c-4181-9164-894cac5e848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:02:31.588616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 614/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:02:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 15:02:31.615301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45262672-f069-49d7-a026-f065a0f06652 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:31.812192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45262672-f069-49d7-a026-f065a0f06652 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:31.878290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99345811-19e5-42df-b646-79fcd624a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:31.879970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99345811-19e5-42df-b646-79fcd624a635 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:31.880515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99345811-19e5-42df-b646-79fcd624a635 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:31.881135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99345811-19e5-42df-b646-79fcd624a635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:31.899808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99345811-19e5-42df-b646-79fcd624a635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:31.901377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99345811-19e5-42df-b646-79fcd624a635 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-99345811-19e5-42df-b646-79fcd624a635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:31.924769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:31.926949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:31.928947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:31.928947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:31.928947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:31.928947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:31.928947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 589/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:31.935097 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373beaff-185c-4181-9164-894cac5e848d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:32.078679 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373beaff-185c-4181-9164-894cac5e848d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:32.112062 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:32.123472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9fa40-de06-4c1f-9b62-e2ac48a02521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:32.124561 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9fa40-de06-4c1f-9b62-e2ac48a02521 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:32.124975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9fa40-de06-4c1f-9b62-e2ac48a02521 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:32.125242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9fa40-de06-4c1f-9b62-e2ac48a02521 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:32.126038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9fa40-de06-4c1f-9b62-e2ac48a02521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:32.126387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9fa40-de06-4c1f-9b62-e2ac48a02521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:32.128227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9fa40-de06-4c1f-9b62-e2ac48a02521 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:32.146004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 615/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:32.150483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99345811-19e5-42df-b646-79fcd624a635 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:32.227037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:32.286875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99345811-19e5-42df-b646-79fcd624a635 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:32.344486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bd06a-8468-4758-a4f2-c3e60fc8acfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:32.345495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bd06a-8468-4758-a4f2-c3e60fc8acfe None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:32.345996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bd06a-8468-4758-a4f2-c3e60fc8acfe None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:32.346398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bd06a-8468-4758-a4f2-c3e60fc8acfe None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:32.347710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bd06a-8468-4758-a4f2-c3e60fc8acfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:32.350862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bd06a-8468-4758-a4f2-c3e60fc8acfe None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:32.380873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 590/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 17 15:02:32 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:02:35.006411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b6af-c582-4671-b8bf-53a90970b753 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:35.007158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b6af-c582-4671-b8bf-53a90970b753 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:35.007387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b6af-c582-4671-b8bf-53a90970b753 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:35.009907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 616/1206] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:02:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:02:35.017366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3df4-984a-47b8-b46f-eb463e1c0418 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:35.018502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3df4-984a-47b8-b46f-eb463e1c0418 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:35.018502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3df4-984a-47b8-b46f-eb463e1c0418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:35.037727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-90cb3df4-984a-47b8-b46f-eb463e1c0418 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:02:35.039039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-90cb3df4-984a-47b8-b46f-eb463e1c0418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:02:35.122149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 591/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:02:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:02:35.151421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38b6af-c582-4671-b8bf-53a90970b753 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:35.292995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38b6af-c582-4671-b8bf-53a90970b753 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:35.337227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9f452-3019-4331-889e-b9f236174d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:35.338196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9f452-3019-4331-889e-b9f236174d69 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:35.338477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9f452-3019-4331-889e-b9f236174d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:35.338747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9f452-3019-4331-889e-b9f236174d69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:35.352906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9f452-3019-4331-889e-b9f236174d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d9c9f452-3019-4331-889e-b9f236174d69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:02:35.361506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:35.362906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:35.369426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 617/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 15:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:35.371812 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb3df4-984a-47b8-b46f-eb463e1c0418 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:35.423432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:35.514087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb3df4-984a-47b8-b46f-eb463e1c0418 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:35.567771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cd5f7-cf1b-4faf-8e8b-f3a8f5adbeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:35.568973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd5f7-cf1b-4faf-8e8b-f3a8f5adbeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:35.569319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd5f7-cf1b-4faf-8e8b-f3a8f5adbeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:35.569601 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd5f7-cf1b-4faf-8e8b-f3a8f5adbeb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:35.570396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cd5f7-cf1b-4faf-8e8b-f3a8f5adbeb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:35.570717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cd5f7-cf1b-4faf-8e8b-f3a8f5adbeb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:35.572644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cd5f7-cf1b-4faf-8e8b-f3a8f5adbeb4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:35.586549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 592/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 15:02:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:35.594183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9f452-3019-4331-889e-b9f236174d69 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:35.660264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:35.742144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9f452-3019-4331-889e-b9f236174d69 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:35.805988 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51acbc-941f-4653-94e9-9ef84525f1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:35.806829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51acbc-941f-4653-94e9-9ef84525f1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:35.807111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51acbc-941f-4653-94e9-9ef84525f1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:35.807390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51acbc-941f-4653-94e9-9ef84525f1e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:35.823010 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51acbc-941f-4653-94e9-9ef84525f1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:35.824906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51acbc-941f-4653-94e9-9ef84525f1e5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fc51acbc-941f-4653-94e9-9ef84525f1e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:35.853256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:35.854270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:35.858278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:35.858278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:35.858278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:35.858278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:35.858278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 618/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:35.860650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cd5f7-cf1b-4faf-8e8b-f3a8f5adbeb4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:35.982665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:35.986666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cd5f7-cf1b-4faf-8e8b-f3a8f5adbeb4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:36.031487 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc4b57-1a95-4985-bb9a-2e1f5d20de6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:36.032409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc4b57-1a95-4985-bb9a-2e1f5d20de6a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:36.032409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc4b57-1a95-4985-bb9a-2e1f5d20de6a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:36.032622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc4b57-1a95-4985-bb9a-2e1f5d20de6a None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:36.033459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc4b57-1a95-4985-bb9a-2e1f5d20de6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:36.033765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc4b57-1a95-4985-bb9a-2e1f5d20de6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:36.035342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc4b57-1a95-4985-bb9a-2e1f5d20de6a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:36.050143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 593/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:36.056768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51acbc-941f-4653-94e9-9ef84525f1e5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:36.176401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51acbc-941f-4653-94e9-9ef84525f1e5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:36.178483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:36.234122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2164a0-930c-494b-ac52-7c40a6558a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:36.235537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2164a0-930c-494b-ac52-7c40a6558a3c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:36.236053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2164a0-930c-494b-ac52-7c40a6558a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:36.236488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2164a0-930c-494b-ac52-7c40a6558a3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:36.247792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2164a0-930c-494b-ac52-7c40a6558a3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:36.249341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2164a0-930c-494b-ac52-7c40a6558a3c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7b2164a0-930c-494b-ac52-7c40a6558a3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:02:36.266900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:36.268197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:36.269401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:36.269401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:36.269401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:02:36.269401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:02:36.269401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:02:36.269401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:02:36.269401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:02:36.269401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:02:36.269401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:02:36.269401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:36.273377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 619/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:36.274583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc4b57-1a95-4985-bb9a-2e1f5d20de6a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:36.401546 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc4b57-1a95-4985-bb9a-2e1f5d20de6a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:36.443355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2939bc5-3f3d-4179-8157-534f4d8e8ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:36.444576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2939bc5-3f3d-4179-8157-534f4d8e8ece None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:36.445263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2939bc5-3f3d-4179-8157-534f4d8e8ece None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:36.445932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2939bc5-3f3d-4179-8157-534f4d8e8ece None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:36.448328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2939bc5-3f3d-4179-8157-534f4d8e8ece None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:36.448969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2939bc5-3f3d-4179-8157-534f4d8e8ece None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:36.450956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2939bc5-3f3d-4179-8157-534f4d8e8ece None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:36.475255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 594/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 17 15:02:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:02:36.482654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2164a0-930c-494b-ac52-7c40a6558a3c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:36.633478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2164a0-930c-494b-ac52-7c40a6558a3c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:36.702492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2aa6a-0f14-4406-884a-93606cd3a37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:36.703548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2aa6a-0f14-4406-884a-93606cd3a37f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:36.704039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2aa6a-0f14-4406-884a-93606cd3a37f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:36.704472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2aa6a-0f14-4406-884a-93606cd3a37f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:36.753185 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:36.812076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2aa6a-0f14-4406-884a-93606cd3a37f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:36.813583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2aa6a-0f14-4406-884a-93606cd3a37f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:36.972648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 620/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:02:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:02:36.978191 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2939bc5-3f3d-4179-8157-534f4d8e8ece None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:37.000866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:37.115169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2939bc5-3f3d-4179-8157-534f4d8e8ece None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:37.161477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b56c22-b85a-4c1e-90ff-379857cc0c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:37.162278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56c22-b85a-4c1e-90ff-379857cc0c68 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:37.162563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56c22-b85a-4c1e-90ff-379857cc0c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:37.162846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56c22-b85a-4c1e-90ff-379857cc0c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:37.174436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b56c22-b85a-4c1e-90ff-379857cc0c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:37.176242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b56c22-b85a-4c1e-90ff-379857cc0c68 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-49b56c22-b85a-4c1e-90ff-379857cc0c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:37.196228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:37.197982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:37.199260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:37.199260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:37.199260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:37.199260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:37.199260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 595/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:37.203689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2aa6a-0f14-4406-884a-93606cd3a37f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:37.282682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:37.334709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2aa6a-0f14-4406-884a-93606cd3a37f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:37.377753 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ec75b-68cf-4704-a200-2c5e0d5ef8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:37.378550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ec75b-68cf-4704-a200-2c5e0d5ef8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:37.379454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ec75b-68cf-4704-a200-2c5e0d5ef8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:37.379454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ec75b-68cf-4704-a200-2c5e0d5ef8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:37.379853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ec75b-68cf-4704-a200-2c5e0d5ef8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:37.380175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ec75b-68cf-4704-a200-2c5e0d5ef8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:37.381670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ec75b-68cf-4704-a200-2c5e0d5ef8c2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:37.395655 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 621/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:37.401565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b56c22-b85a-4c1e-90ff-379857cc0c68 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:37.522145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:37.570876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b56c22-b85a-4c1e-90ff-379857cc0c68 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:37.628220 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8061c3-a28c-4f53-a165-e998de96d302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:37.629148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8061c3-a28c-4f53-a165-e998de96d302 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:37.629455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8061c3-a28c-4f53-a165-e998de96d302 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:37.629860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8061c3-a28c-4f53-a165-e998de96d302 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:37.639072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8061c3-a28c-4f53-a165-e998de96d302 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:37.641695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8061c3-a28c-4f53-a165-e998de96d302 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8a8061c3-a28c-4f53-a165-e998de96d302 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:02:37.657751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:37.658831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:37.659770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:02:37.659770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:02:37.659770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:02:37.659770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:02:37.659770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:02:37.659770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:02:37.659770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:02:37.659770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:37.659770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 596/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:37.665915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ec75b-68cf-4704-a200-2c5e0d5ef8c2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:37.795791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ec75b-68cf-4704-a200-2c5e0d5ef8c2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:37.826939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:37.849873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afad05-8e41-4085-99af-fc69f019a712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:37.851225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afad05-8e41-4085-99af-fc69f019a712 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:37.851758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afad05-8e41-4085-99af-fc69f019a712 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:37.852230 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afad05-8e41-4085-99af-fc69f019a712 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:37.853313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afad05-8e41-4085-99af-fc69f019a712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:37.853801 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afad05-8e41-4085-99af-fc69f019a712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:37.855423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afad05-8e41-4085-99af-fc69f019a712 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:37.872320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 622/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:37.878680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8061c3-a28c-4f53-a165-e998de96d302 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:38.002665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8061c3-a28c-4f53-a165-e998de96d302 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:38.043077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:38.052989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717436-ccdd-4e6a-b094-054fcef04ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:38.053821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717436-ccdd-4e6a-b094-054fcef04ddd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:38.054124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717436-ccdd-4e6a-b094-054fcef04ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:38.054416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717436-ccdd-4e6a-b094-054fcef04ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:38.055474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717436-ccdd-4e6a-b094-054fcef04ddd None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=328d0413dc65420c841b452f45c5b0e4) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:38.055888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717436-ccdd-4e6a-b094-054fcef04ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:38.057945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717436-ccdd-4e6a-b094-054fcef04ddd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:38.081328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 597/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:02:37 2022] GET /identity/v3/role_assignments?user.id=328d0413dc65420c841b452f45c5b0e4&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:40.359138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2689140-ce3e-4fcb-aa0d-1bc0988452d7 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:40.359859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2689140-ce3e-4fcb-aa0d-1bc0988452d7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:40.359859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2689140-ce3e-4fcb-aa0d-1bc0988452d7 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:40.361192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 623/1220] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:02:40.368280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aec858-45d7-4765-9a8f-13feee970b88 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:40.369152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aec858-45d7-4765-9a8f-13feee970b88 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:40.369152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aec858-45d7-4765-9a8f-13feee970b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:40.388027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b3aec858-45d7-4765-9a8f-13feee970b88 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:02:40.389345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b3aec858-45d7-4765-9a8f-13feee970b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:02:40.476496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 598/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:02:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:02:40.510314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2689140-ce3e-4fcb-aa0d-1bc0988452d7 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:40.648200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2689140-ce3e-4fcb-aa0d-1bc0988452d7 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:40.687918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b2e3a-4f88-4068-a564-61289b54e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:40.688743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b2e3a-4f88-4068-a564-61289b54e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:40.689029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b2e3a-4f88-4068-a564-61289b54e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:40.689356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b2e3a-4f88-4068-a564-61289b54e4b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:40.702149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b2e3a-4f88-4068-a564-61289b54e4b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-534b2e3a-4f88-4068-a564-61289b54e4b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:02:40.710277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:40.711354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:40.712219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 624/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 15:02:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:40.718580 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aec858-45d7-4765-9a8f-13feee970b88 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:40.847151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aec858-45d7-4765-9a8f-13feee970b88 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:40.875836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:40.890587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a77eb-6bbf-43c0-b37d-afd4720955a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:40.891573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a77eb-6bbf-43c0-b37d-afd4720955a6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:40.891846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a77eb-6bbf-43c0-b37d-afd4720955a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:40.892215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a77eb-6bbf-43c0-b37d-afd4720955a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:40.893005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a77eb-6bbf-43c0-b37d-afd4720955a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:40.893369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a77eb-6bbf-43c0-b37d-afd4720955a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:40.895317 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a77eb-6bbf-43c0-b37d-afd4720955a6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:40.905461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 599/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 15:02:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:40.912065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b2e3a-4f88-4068-a564-61289b54e4b4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:40.961019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:41.022355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b2e3a-4f88-4068-a564-61289b54e4b4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:41.062707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34281f29-9d4b-4f49-a897-cfd0cdf24347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:41.063960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34281f29-9d4b-4f49-a897-cfd0cdf24347 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:41.064405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34281f29-9d4b-4f49-a897-cfd0cdf24347 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:41.064895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34281f29-9d4b-4f49-a897-cfd0cdf24347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:41.082441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34281f29-9d4b-4f49-a897-cfd0cdf24347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:41.084137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34281f29-9d4b-4f49-a897-cfd0cdf24347 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-34281f29-9d4b-4f49-a897-cfd0cdf24347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:41.103681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:41.104946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:41.107047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:41.107047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:41.107047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:41.107047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:41.107047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 625/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:41.112115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a77eb-6bbf-43c0-b37d-afd4720955a6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:41.250028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a77eb-6bbf-43c0-b37d-afd4720955a6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:41.289274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee186e-4c95-4b0b-9e77-fc7c5718166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:41.289977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee186e-4c95-4b0b-9e77-fc7c5718166a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:41.290389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee186e-4c95-4b0b-9e77-fc7c5718166a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:41.290728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee186e-4c95-4b0b-9e77-fc7c5718166a None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:41.291616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee186e-4c95-4b0b-9e77-fc7c5718166a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:41.291932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee186e-4c95-4b0b-9e77-fc7c5718166a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:41.293676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee186e-4c95-4b0b-9e77-fc7c5718166a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:41.309671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 600/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:02:41.318724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34281f29-9d4b-4f49-a897-cfd0cdf24347 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:41.461835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:41.471987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34281f29-9d4b-4f49-a897-cfd0cdf24347 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:41.526269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530d9b6-c323-4141-b636-b06f07180a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:41.527193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530d9b6-c323-4141-b636-b06f07180a7a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:41.527634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530d9b6-c323-4141-b636-b06f07180a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:41.528018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530d9b6-c323-4141-b636-b06f07180a7a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:41.537671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530d9b6-c323-4141-b636-b06f07180a7a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:41.539157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530d9b6-c323-4141-b636-b06f07180a7a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-6530d9b6-c323-4141-b636-b06f07180a7a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:02:41.554143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:41.555234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:41.556510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 626/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:41.561711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee186e-4c95-4b0b-9e77-fc7c5718166a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:41.616335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:41.692705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee186e-4c95-4b0b-9e77-fc7c5718166a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:41.730735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ed7e2-f112-4419-b076-4105e312274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:41.731488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ed7e2-f112-4419-b076-4105e312274a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:41.731772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ed7e2-f112-4419-b076-4105e312274a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:41.732047 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ed7e2-f112-4419-b076-4105e312274a None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:41.732974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ed7e2-f112-4419-b076-4105e312274a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:41.733381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ed7e2-f112-4419-b076-4105e312274a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:41.734838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ed7e2-f112-4419-b076-4105e312274a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:41.764033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 601/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 17 15:02:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:41.766186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530d9b6-c323-4141-b636-b06f07180a7a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:41.901902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530d9b6-c323-4141-b636-b06f07180a7a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:41.944124 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998364d-56f2-4ac9-be8d-fdc836ea4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:41.945472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998364d-56f2-4ac9-be8d-fdc836ea4af2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:41.945958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998364d-56f2-4ac9-be8d-fdc836ea4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:41.946744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998364d-56f2-4ac9-be8d-fdc836ea4af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:41.966780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998364d-56f2-4ac9-be8d-fdc836ea4af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:41.969626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998364d-56f2-4ac9-be8d-fdc836ea4af2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-2998364d-56f2-4ac9-be8d-fdc836ea4af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:41.989635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:41.990634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:41.991518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:41.991518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:41.991518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:41.991518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:41.991518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 627/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:42.000620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ed7e2-f112-4419-b076-4105e312274a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:42.145102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ed7e2-f112-4419-b076-4105e312274a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:42.147943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:42.188337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09c5b0-d8d0-4f7d-8dc8-4f277e0ec817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:42.189063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09c5b0-d8d0-4f7d-8dc8-4f277e0ec817 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:42.189426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09c5b0-d8d0-4f7d-8dc8-4f277e0ec817 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:42.189793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09c5b0-d8d0-4f7d-8dc8-4f277e0ec817 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:42.190714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09c5b0-d8d0-4f7d-8dc8-4f277e0ec817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:42.191203 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09c5b0-d8d0-4f7d-8dc8-4f277e0ec817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:42.192689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09c5b0-d8d0-4f7d-8dc8-4f277e0ec817 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:42.211307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 602/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:42.212474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998364d-56f2-4ac9-be8d-fdc836ea4af2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:42.222608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:42.340752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998364d-56f2-4ac9-be8d-fdc836ea4af2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:42.380977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11880998-cc27-4d33-a67b-99da3f270ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:42.381833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11880998-cc27-4d33-a67b-99da3f270ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:42.382119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11880998-cc27-4d33-a67b-99da3f270ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:42.382396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11880998-cc27-4d33-a67b-99da3f270ff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:42.391010 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11880998-cc27-4d33-a67b-99da3f270ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:42.392747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11880998-cc27-4d33-a67b-99da3f270ff0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-11880998-cc27-4d33-a67b-99da3f270ff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:02:42.410243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:42.411386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:42.412693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:02:42.412693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:02:42.412693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:02:42.412693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:02:42.412693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:02:42.412693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:02:42.412693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:02:42.412693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:42.412693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 628/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:02:42.417655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09c5b0-d8d0-4f7d-8dc8-4f277e0ec817 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:42.538415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09c5b0-d8d0-4f7d-8dc8-4f277e0ec817 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:42.577341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcbeac-35bd-435f-acd5-39f3eea33ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:42.578288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcbeac-35bd-435f-acd5-39f3eea33ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:42.578485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcbeac-35bd-435f-acd5-39f3eea33ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:42.578660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcbeac-35bd-435f-acd5-39f3eea33ed2 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:42.579509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcbeac-35bd-435f-acd5-39f3eea33ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:42.579829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcbeac-35bd-435f-acd5-39f3eea33ed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:42.581440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcbeac-35bd-435f-acd5-39f3eea33ed2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:42.600742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 603/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:02:42.603054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11880998-cc27-4d33-a67b-99da3f270ff0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:42.682736 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:42.736631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11880998-cc27-4d33-a67b-99da3f270ff0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:42.787727 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1a6dc-4e6f-4a97-99f1-f150a5ed06a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:42.789477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1a6dc-4e6f-4a97-99f1-f150a5ed06a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:42.789893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1a6dc-4e6f-4a97-99f1-f150a5ed06a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:42.790380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1a6dc-4e6f-4a97-99f1-f150a5ed06a1 None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/328d0413dc65420c841b452f45c5b0e4/roles/eda8425696ad4dc7b29f5a2ab7961a35` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:42.816793 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1a6dc-4e6f-4a97-99f1-f150a5ed06a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=328d0413dc65420c841b452f45c5b0e4, role_id=eda8425696ad4dc7b29f5a2ab7961a35)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:42.818603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1a6dc-4e6f-4a97-99f1-f150a5ed06a1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:42.841971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 629/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 15:02:42 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/328d0413dc65420c841b452f45c5b0e4/roles/eda8425696ad4dc7b29f5a2ab7961a35 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:02:45.110660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c14ca-0f53-41e2-b295-006d79a6c165 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:45.111219 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c14ca-0f53-41e2-b295-006d79a6c165 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:45.111219 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c14ca-0f53-41e2-b295-006d79a6c165 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:45.112540 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 604/1233] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:02:45.118515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c4cb-5259-4b12-9767-1d5f618e8c74 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:45.118999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c4cb-5259-4b12-9767-1d5f618e8c74 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:45.119107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c4cb-5259-4b12-9767-1d5f618e8c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:45.139339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f2d3c4cb-5259-4b12-9767-1d5f618e8c74 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:02:45.140557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f2d3c4cb-5259-4b12-9767-1d5f618e8c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:02:45.222147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 630/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:02:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:02:45.248490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c14ca-0f53-41e2-b295-006d79a6c165 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:45.285835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:45.377960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c14ca-0f53-41e2-b295-006d79a6c165 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:45.415915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27b318-a89e-446c-9be5-f158e89d0126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:45.416749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27b318-a89e-446c-9be5-f158e89d0126 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:45.417030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27b318-a89e-446c-9be5-f158e89d0126 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:45.417483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27b318-a89e-446c-9be5-f158e89d0126 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:45.431422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27b318-a89e-446c-9be5-f158e89d0126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3e27b318-a89e-446c-9be5-f158e89d0126 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:02:45.439447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:45.440637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 15:02:45.441644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:45.446784 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 605/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 17 15:02:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:45.447797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c4cb-5259-4b12-9767-1d5f618e8c74 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:45.508429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:45.580889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c4cb-5259-4b12-9767-1d5f618e8c74 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:45.621234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d77d12-9ea4-4377-8919-4ba3d1de1989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:45.621949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d77d12-9ea4-4377-8919-4ba3d1de1989 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:45.622225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d77d12-9ea4-4377-8919-4ba3d1de1989 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:45.622502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d77d12-9ea4-4377-8919-4ba3d1de1989 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:45.623253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d77d12-9ea4-4377-8919-4ba3d1de1989 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:45.623558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d77d12-9ea4-4377-8919-4ba3d1de1989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:45.624929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d77d12-9ea4-4377-8919-4ba3d1de1989 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:45.634713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 631/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 17 15:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:45.640835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27b318-a89e-446c-9be5-f158e89d0126 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:45.753832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:45.775567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27b318-a89e-446c-9be5-f158e89d0126 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:45.825324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2fbd8-2de5-4649-8e44-22e2d7478601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:45.826300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2fbd8-2de5-4649-8e44-22e2d7478601 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:45.826636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2fbd8-2de5-4649-8e44-22e2d7478601 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:45.826993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2fbd8-2de5-4649-8e44-22e2d7478601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:45.840483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2fbd8-2de5-4649-8e44-22e2d7478601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:45.841975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2fbd8-2de5-4649-8e44-22e2d7478601 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-11d2fbd8-2de5-4649-8e44-22e2d7478601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:45.864148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:45.865587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:45.866699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:45.866699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:45.866699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:45.866699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:45.866699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 606/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:45.873085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d77d12-9ea4-4377-8919-4ba3d1de1989 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:46.000978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d77d12-9ea4-4377-8919-4ba3d1de1989 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:46.011145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:46.042691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184d439-82ff-45c5-b43c-d28de3610d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:46.043444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184d439-82ff-45c5-b43c-d28de3610d8a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:46.043731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184d439-82ff-45c5-b43c-d28de3610d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:46.044036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184d439-82ff-45c5-b43c-d28de3610d8a None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:46.044757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184d439-82ff-45c5-b43c-d28de3610d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:46.045074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184d439-82ff-45c5-b43c-d28de3610d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:46.046745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184d439-82ff-45c5-b43c-d28de3610d8a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:46.060420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 632/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:46.067526 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2fbd8-2de5-4649-8e44-22e2d7478601 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:46.208858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2fbd8-2de5-4649-8e44-22e2d7478601 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:46.248277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640c34a-7fff-412a-93be-9f115a821374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:46.249322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640c34a-7fff-412a-93be-9f115a821374 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:46.249605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640c34a-7fff-412a-93be-9f115a821374 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:46.249884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640c34a-7fff-412a-93be-9f115a821374 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:46.253974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:46.260613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640c34a-7fff-412a-93be-9f115a821374 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:46.262634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640c34a-7fff-412a-93be-9f115a821374 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3640c34a-7fff-412a-93be-9f115a821374 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:02:46.279466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:46.280927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:46.282080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 607/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:02:46.288202 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184d439-82ff-45c5-b43c-d28de3610d8a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:46.407111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184d439-82ff-45c5-b43c-d28de3610d8a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:46.445390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f32652-4b76-4e2a-8d19-f88bc3e1663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:46.446547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f32652-4b76-4e2a-8d19-f88bc3e1663f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:46.446782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f32652-4b76-4e2a-8d19-f88bc3e1663f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:46.447098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f32652-4b76-4e2a-8d19-f88bc3e1663f None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:46.448055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f32652-4b76-4e2a-8d19-f88bc3e1663f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:46.448364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f32652-4b76-4e2a-8d19-f88bc3e1663f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:46.449828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f32652-4b76-4e2a-8d19-f88bc3e1663f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:46.470795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 633/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 17 15:02:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:46.476900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640c34a-7fff-412a-93be-9f115a821374 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:46.619852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640c34a-7fff-412a-93be-9f115a821374 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:46.656959 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fce09-dc1d-462e-9e09-9f41cd42973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:46.657679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fce09-dc1d-462e-9e09-9f41cd42973a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:46.657967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fce09-dc1d-462e-9e09-9f41cd42973a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:46.658243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fce09-dc1d-462e-9e09-9f41cd42973a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:46.740645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:46.749850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fce09-dc1d-462e-9e09-9f41cd42973a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:46.751602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fce09-dc1d-462e-9e09-9f41cd42973a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:46.896025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 608/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:02:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:02:46.903192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f32652-4b76-4e2a-8d19-f88bc3e1663f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:46.938868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:47.025671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f32652-4b76-4e2a-8d19-f88bc3e1663f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:47.072597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23080-ec3d-4d82-b45e-6711c9dc666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:47.073486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23080-ec3d-4d82-b45e-6711c9dc666c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:47.073768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23080-ec3d-4d82-b45e-6711c9dc666c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:47.074041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23080-ec3d-4d82-b45e-6711c9dc666c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:47.085499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d23080-ec3d-4d82-b45e-6711c9dc666c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:47.087018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d23080-ec3d-4d82-b45e-6711c9dc666c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-26d23080-ec3d-4d82-b45e-6711c9dc666c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:47.111852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:47.112981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:47.114111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:47.114111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:47.114111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:47.114111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:47.114111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 634/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:02:47.119133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fce09-dc1d-462e-9e09-9f41cd42973a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:47.245880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:47.252974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fce09-dc1d-462e-9e09-9f41cd42973a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:47.297768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1b8d9-2a50-4c1e-a28b-6352823e565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:47.298582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1b8d9-2a50-4c1e-a28b-6352823e565b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:47.298860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1b8d9-2a50-4c1e-a28b-6352823e565b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:47.299134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1b8d9-2a50-4c1e-a28b-6352823e565b None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:47.299933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1b8d9-2a50-4c1e-a28b-6352823e565b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:47.300302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1b8d9-2a50-4c1e-a28b-6352823e565b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:47.302079 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1b8d9-2a50-4c1e-a28b-6352823e565b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:47.318167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 609/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:47.325488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23080-ec3d-4d82-b45e-6711c9dc666c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:47.421502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:47.449041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23080-ec3d-4d82-b45e-6711c9dc666c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:47.492775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a1aca-799d-44a7-8641-1ef51e41f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:47.493737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1aca-799d-44a7-8641-1ef51e41f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:47.494039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1aca-799d-44a7-8641-1ef51e41f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:47.494313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1aca-799d-44a7-8641-1ef51e41f9f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:47.508492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a1aca-799d-44a7-8641-1ef51e41f9f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:47.510165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a1aca-799d-44a7-8641-1ef51e41f9f2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-864a1aca-799d-44a7-8641-1ef51e41f9f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:02:47.526746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:47.527995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:47.529008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:02:47.529008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:02:47.529008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:02:47.529008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:02:47.529008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:02:47.529008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:02:47.529008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:02:47.529008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:47.529008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 635/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 15:02:47.536440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1b8d9-2a50-4c1e-a28b-6352823e565b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:47.659871 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1b8d9-2a50-4c1e-a28b-6352823e565b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:47.709712 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6e601-5ec2-4342-a832-9ed7b0699b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:47.710373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6e601-5ec2-4342-a832-9ed7b0699b98 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:47.710652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6e601-5ec2-4342-a832-9ed7b0699b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:47.710925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6e601-5ec2-4342-a832-9ed7b0699b98 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:47.711721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6e601-5ec2-4342-a832-9ed7b0699b98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:47.712031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6e601-5ec2-4342-a832-9ed7b0699b98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:47.713525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6e601-5ec2-4342-a832-9ed7b0699b98 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:47.729026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 610/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:47.735340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a1aca-799d-44a7-8641-1ef51e41f9f2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:47.870592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a1aca-799d-44a7-8641-1ef51e41f9f2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:47.919005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c32a4-47f7-4f5d-b937-1cd916b83724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:47.919707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c32a4-47f7-4f5d-b937-1cd916b83724 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:47.920014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c32a4-47f7-4f5d-b937-1cd916b83724 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:47.920356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c32a4-47f7-4f5d-b937-1cd916b83724 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:47.921265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c32a4-47f7-4f5d-b937-1cd916b83724 None admin] RBAC: Adding query filter params (role.id=eda8425696ad4dc7b29f5a2ab7961a35, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=328d0413dc65420c841b452f45c5b0e4) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:47.921581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c32a4-47f7-4f5d-b937-1cd916b83724 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:47.923346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c32a4-47f7-4f5d-b937-1cd916b83724 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:47.931541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 636/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:02:47 2022] GET /identity/v3/role_assignments?user.id=328d0413dc65420c841b452f45c5b0e4&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=eda8425696ad4dc7b29f5a2ab7961a35 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:50.392559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7f559-1c76-4c74-a001-7f08a55b7017 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:50.393176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7f559-1c76-4c74-a001-7f08a55b7017 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:50.393176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7f559-1c76-4c74-a001-7f08a55b7017 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:50.394642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 611/1247] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:02:50.400839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531462e-4032-4d75-945c-569836c08be3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:50.401417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531462e-4032-4d75-945c-569836c08be3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:50.401512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531462e-4032-4d75-945c-569836c08be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:50.407208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:50.422041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9531462e-4032-4d75-945c-569836c08be3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:02:50.423401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9531462e-4032-4d75-945c-569836c08be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:02:50.498677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 637/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:02:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:02:50.523418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7f559-1c76-4c74-a001-7f08a55b7017 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:50.544642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:50.653189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7f559-1c76-4c74-a001-7f08a55b7017 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:50.693608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb91d7-5d41-4a08-bc36-af794900da23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:50.694422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb91d7-5d41-4a08-bc36-af794900da23 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:50.694702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb91d7-5d41-4a08-bc36-af794900da23 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:50.694975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb91d7-5d41-4a08-bc36-af794900da23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:50.707670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb91d7-5d41-4a08-bc36-af794900da23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1fdb91d7-5d41-4a08-bc36-af794900da23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:02:50.715593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:50.716659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:50.717518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 612/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:02:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:50.724030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531462e-4032-4d75-945c-569836c08be3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:50.867258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531462e-4032-4d75-945c-569836c08be3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:50.900919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:50.907384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193bf2e-c133-498b-8691-b2133ee445f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:50.907964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193bf2e-c133-498b-8691-b2133ee445f5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:50.908244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193bf2e-c133-498b-8691-b2133ee445f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:50.908531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193bf2e-c133-498b-8691-b2133ee445f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:50.909381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193bf2e-c133-498b-8691-b2133ee445f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:50.909688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193bf2e-c133-498b-8691-b2133ee445f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:50.911096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193bf2e-c133-498b-8691-b2133ee445f5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:50.920522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 638/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:02:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:50.927720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb91d7-5d41-4a08-bc36-af794900da23 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:51.021650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:51.048260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb91d7-5d41-4a08-bc36-af794900da23 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:51.090528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d6034-1e58-44e8-aafe-714cf4748b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:51.091340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6034-1e58-44e8-aafe-714cf4748b7c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:51.091642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6034-1e58-44e8-aafe-714cf4748b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:51.091915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6034-1e58-44e8-aafe-714cf4748b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:51.105654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d6034-1e58-44e8-aafe-714cf4748b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:51.107579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d6034-1e58-44e8-aafe-714cf4748b7c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-188d6034-1e58-44e8-aafe-714cf4748b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:51.129395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:51.130638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:51.131848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:51.131848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:51.131848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:51.131848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:51.131848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 613/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:51.137405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193bf2e-c133-498b-8691-b2133ee445f5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:51.253218 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193bf2e-c133-498b-8691-b2133ee445f5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:51.293128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd6ced-971b-4cff-8a7e-837a36b91fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:51.293944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd6ced-971b-4cff-8a7e-837a36b91fad None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:51.294295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd6ced-971b-4cff-8a7e-837a36b91fad None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:51.294577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd6ced-971b-4cff-8a7e-837a36b91fad None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:51.295355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd6ced-971b-4cff-8a7e-837a36b91fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:51.295652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd6ced-971b-4cff-8a7e-837a36b91fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:51.297286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd6ced-971b-4cff-8a7e-837a36b91fad None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:51.318541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 639/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:02:51.319890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d6034-1e58-44e8-aafe-714cf4748b7c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:51.453990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d6034-1e58-44e8-aafe-714cf4748b7c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:51.489122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:51.498556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3444802-eba0-44e6-a7f5-7b20c8b14714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:51.499379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3444802-eba0-44e6-a7f5-7b20c8b14714 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:51.499635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3444802-eba0-44e6-a7f5-7b20c8b14714 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:51.499911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3444802-eba0-44e6-a7f5-7b20c8b14714 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:51.509152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3444802-eba0-44e6-a7f5-7b20c8b14714 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:51.511461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3444802-eba0-44e6-a7f5-7b20c8b14714 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d3444802-eba0-44e6-a7f5-7b20c8b14714 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:02:51.530983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:51.532841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:51.534292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 614/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:51.541382 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd6ced-971b-4cff-8a7e-837a36b91fad None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:51.616664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:51.662525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd6ced-971b-4cff-8a7e-837a36b91fad None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:51.708982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d12fb0-626c-431b-8bd4-355ecb605375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:51.709703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12fb0-626c-431b-8bd4-355ecb605375 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:51.709978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12fb0-626c-431b-8bd4-355ecb605375 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:51.710247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12fb0-626c-431b-8bd4-355ecb605375 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:51.711084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d12fb0-626c-431b-8bd4-355ecb605375 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:51.711392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d12fb0-626c-431b-8bd4-355ecb605375 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:51.712828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d12fb0-626c-431b-8bd4-355ecb605375 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:51.733994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 640/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 17 15:02:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:51.740774 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3444802-eba0-44e6-a7f5-7b20c8b14714 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:51.861476 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3444802-eba0-44e6-a7f5-7b20c8b14714 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:51.901893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0ca39-b79e-4317-9a9e-08244f6049c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:51.902537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0ca39-b79e-4317-9a9e-08244f6049c4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:51.902818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0ca39-b79e-4317-9a9e-08244f6049c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:51.903096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0ca39-b79e-4317-9a9e-08244f6049c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:51.974157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:51.991369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0ca39-b79e-4317-9a9e-08244f6049c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:51.992913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0ca39-b79e-4317-9a9e-08244f6049c4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:52.131360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 615/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:02:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:02:52.138186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d12fb0-626c-431b-8bd4-355ecb605375 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:52.272666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d12fb0-626c-431b-8bd4-355ecb605375 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:52.289145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:52.325175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00121f-b037-4977-a0a1-01369773ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:52.326176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00121f-b037-4977-a0a1-01369773ea9e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:52.326451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00121f-b037-4977-a0a1-01369773ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:52.326715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00121f-b037-4977-a0a1-01369773ea9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:52.338408 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00121f-b037-4977-a0a1-01369773ea9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:52.339958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00121f-b037-4977-a0a1-01369773ea9e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-be00121f-b037-4977-a0a1-01369773ea9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:52.360249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:52.361600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:52.363491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:52.363491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:52.363491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:52.363491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:52.363491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 641/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:52.367917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0ca39-b79e-4317-9a9e-08244f6049c4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:52.481861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:52.500316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0ca39-b79e-4317-9a9e-08244f6049c4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:52.550534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f309d6a-3ce6-4a84-9f83-b8e4c1533af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:52.551700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f309d6a-3ce6-4a84-9f83-b8e4c1533af3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:52.552161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f309d6a-3ce6-4a84-9f83-b8e4c1533af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:52.552701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f309d6a-3ce6-4a84-9f83-b8e4c1533af3 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:52.554072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f309d6a-3ce6-4a84-9f83-b8e4c1533af3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:52.554567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f309d6a-3ce6-4a84-9f83-b8e4c1533af3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:52.556955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f309d6a-3ce6-4a84-9f83-b8e4c1533af3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:52.573930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 616/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:52.582556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00121f-b037-4977-a0a1-01369773ea9e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:52.714025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00121f-b037-4977-a0a1-01369773ea9e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:52.769346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be696b-0333-4fdd-b8cc-1feb6278fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:52.770171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be696b-0333-4fdd-b8cc-1feb6278fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:52.770457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be696b-0333-4fdd-b8cc-1feb6278fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:52.770731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be696b-0333-4fdd-b8cc-1feb6278fcb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:52.779293 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be696b-0333-4fdd-b8cc-1feb6278fcb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:52.780958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be696b-0333-4fdd-b8cc-1feb6278fcb4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-63be696b-0333-4fdd-b8cc-1feb6278fcb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:02:52.803477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:52.804591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:52.805777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:02:52.805777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:02:52.805777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:02:52.805777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:02:52.805777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:02:52.805777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:02:52.805777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:02:52.805777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:02:52.805777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 642/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:52.811687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f309d6a-3ce6-4a84-9f83-b8e4c1533af3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:52.933410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f309d6a-3ce6-4a84-9f83-b8e4c1533af3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:52.976766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510326-c168-43fb-8869-94ef372932d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:52.977583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510326-c168-43fb-8869-94ef372932d4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:52.977863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510326-c168-43fb-8869-94ef372932d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:52.978142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510326-c168-43fb-8869-94ef372932d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:52.979089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1510326-c168-43fb-8869-94ef372932d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:52.979405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1510326-c168-43fb-8869-94ef372932d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:52.980859 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1510326-c168-43fb-8869-94ef372932d4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:52.995798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 617/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:53.002127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be696b-0333-4fdd-b8cc-1feb6278fcb4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:53.035645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:53.125267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be696b-0333-4fdd-b8cc-1feb6278fcb4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:53.165236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c11ce-acf3-4797-9131-76bfac79aa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:53.165236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c11ce-acf3-4797-9131-76bfac79aa99 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:53.165236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c11ce-acf3-4797-9131-76bfac79aa99 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:53.165236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c11ce-acf3-4797-9131-76bfac79aa99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:53.165785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c11ce-acf3-4797-9131-76bfac79aa99 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=328d0413dc65420c841b452f45c5b0e4) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:53.165785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c11ce-acf3-4797-9131-76bfac79aa99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:53.166644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c11ce-acf3-4797-9131-76bfac79aa99 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:53.173324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 643/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:02:53 2022] GET /identity/v3/role_assignments?user.id=328d0413dc65420c841b452f45c5b0e4&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=8a6fe5045159487aa0119348cfe94387 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:55.374704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780b002-6e45-4a94-8b3f-1083ea75dc61 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:55.375274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780b002-6e45-4a94-8b3f-1083ea75dc61 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:55.375274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780b002-6e45-4a94-8b3f-1083ea75dc61 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:55.376594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 618/1261] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:02:55.382127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee038ea-b79f-4b84-bab7-149cefbc9c6a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:55.382566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee038ea-b79f-4b84-bab7-149cefbc9c6a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:55.382653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee038ea-b79f-4b84-bab7-149cefbc9c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:55.400621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0ee038ea-b79f-4b84-bab7-149cefbc9c6a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:02:55.401845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0ee038ea-b79f-4b84-bab7-149cefbc9c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:02:55.475042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 644/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:02:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:02:55.498649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780b002-6e45-4a94-8b3f-1083ea75dc61 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:55.512530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:55.626880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780b002-6e45-4a94-8b3f-1083ea75dc61 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:55.663432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7fe7c-25ce-4559-ab8e-17ab375fe99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:55.664235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7fe7c-25ce-4559-ab8e-17ab375fe99a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:55.664513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7fe7c-25ce-4559-ab8e-17ab375fe99a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:55.664787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7fe7c-25ce-4559-ab8e-17ab375fe99a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:55.676856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7fe7c-25ce-4559-ab8e-17ab375fe99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ddf7fe7c-25ce-4559-ab8e-17ab375fe99a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:02:55.684578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:55.685717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:02:55.686728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:55.689460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 619/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:02:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:55.693149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee038ea-b79f-4b84-bab7-149cefbc9c6a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:55.718858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:55.839186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee038ea-b79f-4b84-bab7-149cefbc9c6a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:55.888114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674207ea-eb4e-4cf4-9ad6-2c338e5f1d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:55.888800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674207ea-eb4e-4cf4-9ad6-2c338e5f1d53 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:55.889083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674207ea-eb4e-4cf4-9ad6-2c338e5f1d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:55.889394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674207ea-eb4e-4cf4-9ad6-2c338e5f1d53 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:55.890164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674207ea-eb4e-4cf4-9ad6-2c338e5f1d53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:55.891869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674207ea-eb4e-4cf4-9ad6-2c338e5f1d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:55.891869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674207ea-eb4e-4cf4-9ad6-2c338e5f1d53 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:55.901903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 645/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:02:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:55.908125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7fe7c-25ce-4559-ab8e-17ab375fe99a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:55.995708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:56.051176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7fe7c-25ce-4559-ab8e-17ab375fe99a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:56.095234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2f429-f657-48c6-b1e7-1ebe632e1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:56.096042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2f429-f657-48c6-b1e7-1ebe632e1d7c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:56.097763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2f429-f657-48c6-b1e7-1ebe632e1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:56.098060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2f429-f657-48c6-b1e7-1ebe632e1d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:56.110356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2f429-f657-48c6-b1e7-1ebe632e1d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:56.112002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2f429-f657-48c6-b1e7-1ebe632e1d7c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ccf2f429-f657-48c6-b1e7-1ebe632e1d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:56.132731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:56.134046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:56.135440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:56.135440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:56.135440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:56.135440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:56.135440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 620/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:56.140164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674207ea-eb4e-4cf4-9ad6-2c338e5f1d53 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:56.233825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:56.256092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674207ea-eb4e-4cf4-9ad6-2c338e5f1d53 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:56.301832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7713-5fef-46e9-b9f9-40775c89073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:56.302811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7713-5fef-46e9-b9f9-40775c89073c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:56.303223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7713-5fef-46e9-b9f9-40775c89073c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:56.303624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7713-5fef-46e9-b9f9-40775c89073c None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:56.304731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab7713-5fef-46e9-b9f9-40775c89073c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:56.305277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab7713-5fef-46e9-b9f9-40775c89073c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:56.307698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab7713-5fef-46e9-b9f9-40775c89073c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:56.325014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 646/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:56.331195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2f429-f657-48c6-b1e7-1ebe632e1d7c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:56.456270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2f429-f657-48c6-b1e7-1ebe632e1d7c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:56.481521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:56.501195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52060c-6622-4c2f-8421-9ccfdfb45ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:56.502228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52060c-6622-4c2f-8421-9ccfdfb45ddc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:56.502789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52060c-6622-4c2f-8421-9ccfdfb45ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:56.503396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52060c-6622-4c2f-8421-9ccfdfb45ddc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:56.524775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52060c-6622-4c2f-8421-9ccfdfb45ddc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:56.526292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52060c-6622-4c2f-8421-9ccfdfb45ddc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4c52060c-6622-4c2f-8421-9ccfdfb45ddc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:02:56.548806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:56.550336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:56.551399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 621/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:56.557113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7713-5fef-46e9-b9f9-40775c89073c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:56.680543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7713-5fef-46e9-b9f9-40775c89073c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:56.721118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31dd25-6a08-4acd-bd46-5d1efefae779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:56.721815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31dd25-6a08-4acd-bd46-5d1efefae779 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:56.722085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31dd25-6a08-4acd-bd46-5d1efefae779 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:56.722358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31dd25-6a08-4acd-bd46-5d1efefae779 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:56.727682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31dd25-6a08-4acd-bd46-5d1efefae779 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:56.727682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31dd25-6a08-4acd-bd46-5d1efefae779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:56.727682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31dd25-6a08-4acd-bd46-5d1efefae779 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:56.735527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:56.747203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 647/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 17 15:02:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:56.753324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52060c-6622-4c2f-8421-9ccfdfb45ddc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:56.872695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52060c-6622-4c2f-8421-9ccfdfb45ddc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:56.908209 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dceaec-115c-4229-93a6-18ff15cf2e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:56.909109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dceaec-115c-4229-93a6-18ff15cf2e64 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:56.909420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dceaec-115c-4229-93a6-18ff15cf2e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:56.909700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dceaec-115c-4229-93a6-18ff15cf2e64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:56.921100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dceaec-115c-4229-93a6-18ff15cf2e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:56.922606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dceaec-115c-4229-93a6-18ff15cf2e64 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-06dceaec-115c-4229-93a6-18ff15cf2e64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:02:56.940970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:56.942876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:56.944820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:02:56.944820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:02:56.944820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:02:56.944820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:56.944820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 622/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:56.948512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31dd25-6a08-4acd-bd46-5d1efefae779 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:57.060398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31dd25-6a08-4acd-bd46-5d1efefae779 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:57.095832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decaab-f5c0-4d7b-913e-7c31da7054a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:57.099067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decaab-f5c0-4d7b-913e-7c31da7054a6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:57.099067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decaab-f5c0-4d7b-913e-7c31da7054a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:57.099067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decaab-f5c0-4d7b-913e-7c31da7054a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:57.099067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00decaab-f5c0-4d7b-913e-7c31da7054a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:57.099067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00decaab-f5c0-4d7b-913e-7c31da7054a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:57.099774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00decaab-f5c0-4d7b-913e-7c31da7054a6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:57.111548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 648/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:02:57.117836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dceaec-115c-4229-93a6-18ff15cf2e64 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:57.153084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:57.236089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dceaec-115c-4229-93a6-18ff15cf2e64 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:57.284675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa26de-e851-4110-b019-663ca8718694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:57.285600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa26de-e851-4110-b019-663ca8718694 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:57.285913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa26de-e851-4110-b019-663ca8718694 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:57.286168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa26de-e851-4110-b019-663ca8718694 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:57.293928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa26de-e851-4110-b019-663ca8718694 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:57.295403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa26de-e851-4110-b019-663ca8718694 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8faa26de-e851-4110-b019-663ca8718694 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:02:57.310765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:02:57.311845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:02:57.312893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:02:57.312893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:02:57.312893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:02:57.312893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:02:57.312893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:02:57.312893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:02:57.312893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:02:57.312893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:02:57.312893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 623/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:02:57.318394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decaab-f5c0-4d7b-913e-7c31da7054a6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:57.387045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:57.433129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decaab-f5c0-4d7b-913e-7c31da7054a6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:57.469812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77631c8-bd46-41fb-ba49-bec8f40bf774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:57.470474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77631c8-bd46-41fb-ba49-bec8f40bf774 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:57.470754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77631c8-bd46-41fb-ba49-bec8f40bf774 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:57.471061 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77631c8-bd46-41fb-ba49-bec8f40bf774 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:57.471827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77631c8-bd46-41fb-ba49-bec8f40bf774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:02:57.472216 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77631c8-bd46-41fb-ba49-bec8f40bf774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:57.473691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77631c8-bd46-41fb-ba49-bec8f40bf774 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:57.487249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 649/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:02:57.494025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa26de-e851-4110-b019-663ca8718694 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:02:57.605982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:02:57.618183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa26de-e851-4110-b019-663ca8718694 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:02:57.655356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80633129-83e0-48fd-a39e-baf790e0e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:02:57.656290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80633129-83e0-48fd-a39e-baf790e0e513 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:57.656571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80633129-83e0-48fd-a39e-baf790e0e513 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:57.656849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80633129-83e0-48fd-a39e-baf790e0e513 None admin] PATH_INFO: `/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/328d0413dc65420c841b452f45c5b0e4/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:57.659140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80633129-83e0-48fd-a39e-baf790e0e513 None admin] RBAC: Authorizing `identity:create_grant(project_id=82df3e8cae9d4da0adb35aa5ed99e3ad, user_id=328d0413dc65420c841b452f45c5b0e4, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:02:57.660626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80633129-83e0-48fd-a39e-baf790e0e513 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:02:57.677239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 624/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 17 15:02:57 2022] PUT /identity/v3/projects/82df3e8cae9d4da0adb35aa5ed99e3ad/users/328d0413dc65420c841b452f45c5b0e4/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:02:59.808113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8651e-f449-4fc8-8b3c-51cf0729bde6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:59.808707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8651e-f449-4fc8-8b3c-51cf0729bde6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:59.808707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8651e-f449-4fc8-8b3c-51cf0729bde6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:59.810049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 650/1274] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:02:59.822665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647464a-ecf4-4a8d-970a-5db6cc7de4c2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:02:59.823311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647464a-ecf4-4a8d-970a-5db6cc7de4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:02:59.823311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647464a-ecf4-4a8d-970a-5db6cc7de4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:02:59.843099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1647464a-ecf4-4a8d-970a-5db6cc7de4c2 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:02:59.844313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1647464a-ecf4-4a8d-970a-5db6cc7de4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:02:59.918061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 625/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:02:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:02:59.949103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8651e-f449-4fc8-8b3c-51cf0729bde6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:00.057829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8651e-f449-4fc8-8b3c-51cf0729bde6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:00.076229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:00.094418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eab23-6b5b-42a2-bef2-c9984cc23077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:00.095223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eab23-6b5b-42a2-bef2-c9984cc23077 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:00.095506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eab23-6b5b-42a2-bef2-c9984cc23077 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:00.095779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eab23-6b5b-42a2-bef2-c9984cc23077 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:00.106823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eab23-6b5b-42a2-bef2-c9984cc23077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-693eab23-6b5b-42a2-bef2-c9984cc23077 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 15:03:00.114724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:03:00.115842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:00.116833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 651/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 17 15:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:03:00.122385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647464a-ecf4-4a8d-970a-5db6cc7de4c2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:00.214376 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:00.234039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647464a-ecf4-4a8d-970a-5db6cc7de4c2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:00.271621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213a52-2427-48b6-b0c1-7df451aebd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:00.272287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213a52-2427-48b6-b0c1-7df451aebd12 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:00.272566 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213a52-2427-48b6-b0c1-7df451aebd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:00.272842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213a52-2427-48b6-b0c1-7df451aebd12 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:00.273622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4213a52-2427-48b6-b0c1-7df451aebd12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:00.273906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4213a52-2427-48b6-b0c1-7df451aebd12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:00.275321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4213a52-2427-48b6-b0c1-7df451aebd12 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:00.284596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 626/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 17 15:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:03:00.290832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eab23-6b5b-42a2-bef2-c9984cc23077 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:00.405512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eab23-6b5b-42a2-bef2-c9984cc23077 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:00.446442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d687b9-9172-40f6-8fd8-e3bfd370f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:00.447242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d687b9-9172-40f6-8fd8-e3bfd370f084 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:00.447520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d687b9-9172-40f6-8fd8-e3bfd370f084 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:00.447796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d687b9-9172-40f6-8fd8-e3bfd370f084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:00.459224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d687b9-9172-40f6-8fd8-e3bfd370f084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:00.460687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d687b9-9172-40f6-8fd8-e3bfd370f084 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-42d687b9-9172-40f6-8fd8-e3bfd370f084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:03:00.478654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:03:00.480423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:03:00.481450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:03:00.481450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:03:00.481450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:03:00.481450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:00.481450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 652/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:03:00.486055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213a52-2427-48b6-b0c1-7df451aebd12 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:00.629235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213a52-2427-48b6-b0c1-7df451aebd12 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:00.665681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68544ebf-ad18-45bd-8088-d636fc705ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:00.666263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68544ebf-ad18-45bd-8088-d636fc705ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:00.666543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68544ebf-ad18-45bd-8088-d636fc705ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:00.666812 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68544ebf-ad18-45bd-8088-d636fc705ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:00.667544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68544ebf-ad18-45bd-8088-d636fc705ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:00.667854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68544ebf-ad18-45bd-8088-d636fc705ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:00.669244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68544ebf-ad18-45bd-8088-d636fc705ef8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:00.683155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 627/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:03:00.689137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d687b9-9172-40f6-8fd8-e3bfd370f084 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:00.724831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:00.816333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d687b9-9172-40f6-8fd8-e3bfd370f084 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:00.852283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448b3e9-4f51-448a-b4f6-d6b3911ef96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:00.853126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448b3e9-4f51-448a-b4f6-d6b3911ef96b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:00.853433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448b3e9-4f51-448a-b4f6-d6b3911ef96b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:00.853706 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448b3e9-4f51-448a-b4f6-d6b3911ef96b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:00.861724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448b3e9-4f51-448a-b4f6-d6b3911ef96b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:00.863193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448b3e9-4f51-448a-b4f6-d6b3911ef96b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-2448b3e9-4f51-448a-b4f6-d6b3911ef96b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 15:03:00.878422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:03:00.879641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:00.881631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 653/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:03:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:03:00.888770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68544ebf-ad18-45bd-8088-d636fc705ef8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:00.894270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:01.012761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68544ebf-ad18-45bd-8088-d636fc705ef8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:01.050418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3c33d-ffe7-478c-9ece-bd16b0ac3a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:01.051089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3c33d-ffe7-478c-9ece-bd16b0ac3a63 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:01.051372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3c33d-ffe7-478c-9ece-bd16b0ac3a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:01.051643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3c33d-ffe7-478c-9ece-bd16b0ac3a63 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:01.052484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3c33d-ffe7-478c-9ece-bd16b0ac3a63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:01.052792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3c33d-ffe7-478c-9ece-bd16b0ac3a63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:01.054296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3c33d-ffe7-478c-9ece-bd16b0ac3a63 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:01.072853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 628/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 17 15:03:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:03:01.078832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448b3e9-4f51-448a-b4f6-d6b3911ef96b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:01.191841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:01.202416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448b3e9-4f51-448a-b4f6-d6b3911ef96b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:01.245617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eb12f-32d9-4e29-9416-67d8b301148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:01.246258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eb12f-32d9-4e29-9416-67d8b301148e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:01.246552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eb12f-32d9-4e29-9416-67d8b301148e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:01.246920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eb12f-32d9-4e29-9416-67d8b301148e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:01.323111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02eb12f-32d9-4e29-9416-67d8b301148e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:01.324462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02eb12f-32d9-4e29-9416-67d8b301148e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:01.430325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:01.441179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 654/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 17 15:03:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 15:03:01.447602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3c33d-ffe7-478c-9ece-bd16b0ac3a63 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:01.533554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:01.575026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3c33d-ffe7-478c-9ece-bd16b0ac3a63 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:01.611597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f8f49-71fb-475a-b231-d3273ad94230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:01.612776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8f49-71fb-475a-b231-d3273ad94230 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:01.613063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8f49-71fb-475a-b231-d3273ad94230 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:01.613383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8f49-71fb-475a-b231-d3273ad94230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:01.624266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f8f49-71fb-475a-b231-d3273ad94230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:01.625775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f8f49-71fb-475a-b231-d3273ad94230 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-386f8f49-71fb-475a-b231-d3273ad94230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 15:03:01.644492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:03:01.646119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:03:01.648271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 15:03:01.648271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 15:03:01.648271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 15:03:01.648271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:03:01.648271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 629/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:03:01.651780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eb12f-32d9-4e29-9416-67d8b301148e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:01.759629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eb12f-32d9-4e29-9416-67d8b301148e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:01.797806 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e78bc8-f13a-4573-af6b-1f39ed4dda18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:01.798486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e78bc8-f13a-4573-af6b-1f39ed4dda18 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:01.798765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e78bc8-f13a-4573-af6b-1f39ed4dda18 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:01.799152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e78bc8-f13a-4573-af6b-1f39ed4dda18 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:01.800176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e78bc8-f13a-4573-af6b-1f39ed4dda18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:01.800483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e78bc8-f13a-4573-af6b-1f39ed4dda18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:01.801894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e78bc8-f13a-4573-af6b-1f39ed4dda18 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:01.813793 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 655/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 17 15:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:03:01.820019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f8f49-71fb-475a-b231-d3273ad94230 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:01.944225 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f8f49-71fb-475a-b231-d3273ad94230 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:01.960047 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:01.990680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b12a15-b67a-4d20-bd84-c1d701af603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:01.991507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b12a15-b67a-4d20-bd84-c1d701af603f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:01.991791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b12a15-b67a-4d20-bd84-c1d701af603f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:01.992070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b12a15-b67a-4d20-bd84-c1d701af603f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:01.999679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b12a15-b67a-4d20-bd84-c1d701af603f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:02.001149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b12a15-b67a-4d20-bd84-c1d701af603f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-55b12a15-b67a-4d20-bd84-c1d701af603f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 15:03:02.016316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:03:02.018013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:03:02.018951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 15:03:02.018951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 15:03:02.018951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 15:03:02.018951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 15:03:02.018951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 15:03:02.018951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 15:03:02.018951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 15:03:02.018951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jun 17 15:03:02.018951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 630/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 17 15:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:03:02.026562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e78bc8-f13a-4573-af6b-1f39ed4dda18 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:02.088476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:02.145739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e78bc8-f13a-4573-af6b-1f39ed4dda18 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:02.185187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c28ef-3d6a-4872-a3eb-cce7ab7690a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:02.185891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c28ef-3d6a-4872-a3eb-cce7ab7690a7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:02.186189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c28ef-3d6a-4872-a3eb-cce7ab7690a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:02.186464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c28ef-3d6a-4872-a3eb-cce7ab7690a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:02.187248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c28ef-3d6a-4872-a3eb-cce7ab7690a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:02.187555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c28ef-3d6a-4872-a3eb-cce7ab7690a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:02.188989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c28ef-3d6a-4872-a3eb-cce7ab7690a7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:02.202139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 656/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 17 15:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:03:02.208460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b12a15-b67a-4d20-bd84-c1d701af603f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:02.325875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b12a15-b67a-4d20-bd84-c1d701af603f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:02.361950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c3e6a-1e29-4399-8746-aa2471a335a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:02.362707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c3e6a-1e29-4399-8746-aa2471a335a9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:02.362986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c3e6a-1e29-4399-8746-aa2471a335a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:02.363261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c3e6a-1e29-4399-8746-aa2471a335a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:02.364104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c3e6a-1e29-4399-8746-aa2471a335a9 None admin] RBAC: Adding query filter params (role.id=8a6fe5045159487aa0119348cfe94387, scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad, user.id=328d0413dc65420c841b452f45c5b0e4) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:02.364418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c3e6a-1e29-4399-8746-aa2471a335a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:02.365917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c3e6a-1e29-4399-8746-aa2471a335a9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:02.372397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 631/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 17 15:03:02 2022] GET /identity/v3/role_assignments?user.id=328d0413dc65420c841b452f45c5b0e4&scope.project.id=82df3e8cae9d4da0adb35aa5ed99e3ad&role.id=8a6fe5045159487aa0119348cfe94387 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:03:04.540387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36062a2-14d4-4f4b-8a81-26162e362c53 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:04.541141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36062a2-14d4-4f4b-8a81-26162e362c53 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:04.541141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36062a2-14d4-4f4b-8a81-26162e362c53 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:04.542743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 657/1288] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:03:04.548705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c8dac-e3d1-4f43-a610-3dced43f96b5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:04.549321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c8dac-e3d1-4f43-a610-3dced43f96b5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:04.549420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c8dac-e3d1-4f43-a610-3dced43f96b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:04.569146 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d70c8dac-e3d1-4f43-a610-3dced43f96b5 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:03:04.570878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d70c8dac-e3d1-4f43-a610-3dced43f96b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:03:04.609874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:04.651540 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 632/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:03:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:03:04.674052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36062a2-14d4-4f4b-8a81-26162e362c53 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:04.788241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36062a2-14d4-4f4b-8a81-26162e362c53 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:04.800944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:04.836797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bfe33-45c9-40d3-8df5-abe4725331dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:04.837652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfe33-45c9-40d3-8df5-abe4725331dd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:04.837937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfe33-45c9-40d3-8df5-abe4725331dd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:04.838214 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfe33-45c9-40d3-8df5-abe4725331dd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:04.838872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bfe33-45c9-40d3-8df5-abe4725331dd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:04.840244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bfe33-45c9-40d3-8df5-abe4725331dd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-2b3bfe33-45c9-40d3-8df5-abe4725331dd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:03:04.853730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:03:04.855007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:04.855931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 658/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 17 15:03:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:03:04.861722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c8dac-e3d1-4f43-a610-3dced43f96b5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:04.969317 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c8dac-e3d1-4f43-a610-3dced43f96b5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:05.006320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef007-3742-4de4-83a1-4bf082314639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:05.006992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef007-3742-4de4-83a1-4bf082314639 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:05.007275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef007-3742-4de4-83a1-4bf082314639 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:05.007550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef007-3742-4de4-83a1-4bf082314639 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:05.008276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eef007-3742-4de4-83a1-4bf082314639 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:05.008583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eef007-3742-4de4-83a1-4bf082314639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:05.010002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eef007-3742-4de4-83a1-4bf082314639 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:05.015634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 633/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Jun 17 15:03:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:03:05.022133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bfe33-45c9-40d3-8df5-abe4725331dd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:05.137601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bfe33-45c9-40d3-8df5-abe4725331dd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:05.178924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b0148-92f1-4977-b2bb-3ffbbb7a6432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:05.179600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b0148-92f1-4977-b2bb-3ffbbb7a6432 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:05.179884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b0148-92f1-4977-b2bb-3ffbbb7a6432 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:05.180157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b0148-92f1-4977-b2bb-3ffbbb7a6432 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:05.180838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b0148-92f1-4977-b2bb-3ffbbb7a6432 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:05.181142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b0148-92f1-4977-b2bb-3ffbbb7a6432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:05.182558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b0148-92f1-4977-b2bb-3ffbbb7a6432 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:05.187565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 659/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Jun 17 15:03:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:03:07.335377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46671-9839-4fbc-aef4-edbae6cf9463 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:07.336027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46671-9839-4fbc-aef4-edbae6cf9463 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:07.336027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46671-9839-4fbc-aef4-edbae6cf9463 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:07.337332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 634/1293] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:03:07.342970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc8ddf-4249-453b-9786-645f6f5e5c93 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:07.343433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc8ddf-4249-453b-9786-645f6f5e5c93 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:07.343544 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc8ddf-4249-453b-9786-645f6f5e5c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:07.366733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e5dc8ddf-4249-453b-9786-645f6f5e5c93 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:03:07.367964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e5dc8ddf-4249-453b-9786-645f6f5e5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:03:07.403260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:07.446114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 660/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:03:07.470169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a46671-9839-4fbc-aef4-edbae6cf9463 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:07.507570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:07.586144 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a46671-9839-4fbc-aef4-edbae6cf9463 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:07.624768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7f398-89ce-417c-b6c0-da18c0b6d86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:07.625474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7f398-89ce-417c-b6c0-da18c0b6d86d None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:07.625737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7f398-89ce-417c-b6c0-da18c0b6d86d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:07.626018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7f398-89ce-417c-b6c0-da18c0b6d86d None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:07.626755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7f398-89ce-417c-b6c0-da18c0b6d86d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:07.628298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7f398-89ce-417c-b6c0-da18c0b6d86d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:07.645917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 635/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 17 15:03:07 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:03:09.801963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd53b5d-4aeb-4853-b8d7-3c3722dc1c13 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:09.802572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd53b5d-4aeb-4853-b8d7-3c3722dc1c13 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:09.802881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd53b5d-4aeb-4853-b8d7-3c3722dc1c13 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:09.804471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 661/1296] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:03:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:03:09.811942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59f180-04f8-461a-a273-b80e3d602450 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:09.812480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59f180-04f8-461a-a273-b80e3d602450 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:09.812480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59f180-04f8-461a-a273-b80e3d602450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:09.831166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5e59f180-04f8-461a-a273-b80e3d602450 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:03:09.832378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5e59f180-04f8-461a-a273-b80e3d602450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:03:09.914213 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 636/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:03:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:03:09.937323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd53b5d-4aeb-4853-b8d7-3c3722dc1c13 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:10.059408 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd53b5d-4aeb-4853-b8d7-3c3722dc1c13 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:10.099724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f44e8-74f9-4688-8f85-1e9fd9ebb0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:10.100569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f44e8-74f9-4688-8f85-1e9fd9ebb0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:10.100840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f44e8-74f9-4688-8f85-1e9fd9ebb0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:10.101107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f44e8-74f9-4688-8f85-1e9fd9ebb0c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:10.101808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f44e8-74f9-4688-8f85-1e9fd9ebb0c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:10.103173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f44e8-74f9-4688-8f85-1e9fd9ebb0c8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-002f44e8-74f9-4688-8f85-1e9fd9ebb0c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:03:10.115486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:03:10.116778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:10.118399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 662/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 17 15:03:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:03:10.123532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59f180-04f8-461a-a273-b80e3d602450 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:10.148013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:10.242897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59f180-04f8-461a-a273-b80e3d602450 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:10.279327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6b4a-999c-4bc9-b078-7bed82c1d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:10.280001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6b4a-999c-4bc9-b078-7bed82c1d463 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:10.280261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6b4a-999c-4bc9-b078-7bed82c1d463 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:10.280564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6b4a-999c-4bc9-b078-7bed82c1d463 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:10.281303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b6b4a-999c-4bc9-b078-7bed82c1d463 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:10.281607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b6b4a-999c-4bc9-b078-7bed82c1d463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:10.283061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b6b4a-999c-4bc9-b078-7bed82c1d463 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:10.288788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 637/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Jun 17 15:03:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:03:10.294975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f44e8-74f9-4688-8f85-1e9fd9ebb0c8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:10.330892 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:10.417310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f44e8-74f9-4688-8f85-1e9fd9ebb0c8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:10.453420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad688b-91d8-470c-9828-ac90c953e0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:10.454084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad688b-91d8-470c-9828-ac90c953e0af None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:10.454364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad688b-91d8-470c-9828-ac90c953e0af None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:10.454639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad688b-91d8-470c-9828-ac90c953e0af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:10.455750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad688b-91d8-470c-9828-ac90c953e0af None admin] RBAC: Adding query filter params (interface=public, service_id=b4ea409e35d84d049f870fd3ba1f4b9b, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:10.455750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad688b-91d8-470c-9828-ac90c953e0af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:10.457171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad688b-91d8-470c-9828-ac90c953e0af None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:10.464187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 663/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 17 15:03:10 2022] GET /identity/v3/endpoints?service_id=b4ea409e35d84d049f870fd3ba1f4b9b&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:03:10.472230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6b4a-999c-4bc9-b078-7bed82c1d463 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:10.572928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:10.595772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6b4a-999c-4bc9-b078-7bed82c1d463 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:10.633384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cda4fb-25d4-46a8-a6a0-a126c50d3d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:10.634051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda4fb-25d4-46a8-a6a0-a126c50d3d57 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:10.634324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda4fb-25d4-46a8-a6a0-a126c50d3d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:10.634590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda4fb-25d4-46a8-a6a0-a126c50d3d57 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:10.635276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cda4fb-25d4-46a8-a6a0-a126c50d3d57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:10.636651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cda4fb-25d4-46a8-a6a0-a126c50d3d57 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:10.644360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 638/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 17 15:03:10 2022] GET /identity/v3/services => generated 2191 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:03:12.868665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1b509-fd2d-4bc9-9166-899a66a7b9dd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:12.869431 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1b509-fd2d-4bc9-9166-899a66a7b9dd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:12.869431 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1b509-fd2d-4bc9-9166-899a66a7b9dd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:12.871130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 664/1302] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:03:12.876715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917a6db-b74c-402b-9b02-ea076787c6fc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:12.877195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917a6db-b74c-402b-9b02-ea076787c6fc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:12.877325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917a6db-b74c-402b-9b02-ea076787c6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:12.897579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8917a6db-b74c-402b-9b02-ea076787c6fc None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:03:12.898797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8917a6db-b74c-402b-9b02-ea076787c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:03:12.994520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 639/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:03:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 15:03:13.017998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1b509-fd2d-4bc9-9166-899a66a7b9dd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:13.138239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:13.146624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1b509-fd2d-4bc9-9166-899a66a7b9dd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:13.189346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a3fd4-8314-4e28-a230-4f65319e9b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:13.190162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a3fd4-8314-4e28-a230-4f65319e9b8a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:13.190444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a3fd4-8314-4e28-a230-4f65319e9b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:13.190720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a3fd4-8314-4e28-a230-4f65319e9b8a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:13.191373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a3fd4-8314-4e28-a230-4f65319e9b8a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:13.192752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a3fd4-8314-4e28-a230-4f65319e9b8a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8b0a3fd4-8314-4e28-a230-4f65319e9b8a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 15:03:13.205412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 15:03:13.206765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jun 17 15:03:13.207772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 665/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 17 15:03:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 15:03:13.215283 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917a6db-b74c-402b-9b02-ea076787c6fc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:13.307574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:13.334278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917a6db-b74c-402b-9b02-ea076787c6fc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:13.371513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4099b-2cc4-4aac-8b4b-ebf04e57be37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:13.372261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4099b-2cc4-4aac-8b4b-ebf04e57be37 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:13.372499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4099b-2cc4-4aac-8b4b-ebf04e57be37 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:13.372743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4099b-2cc4-4aac-8b4b-ebf04e57be37 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:13.373485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4099b-2cc4-4aac-8b4b-ebf04e57be37 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:03:13.373798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4099b-2cc4-4aac-8b4b-ebf04e57be37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:13.375198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4099b-2cc4-4aac-8b4b-ebf04e57be37 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:13.380906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 640/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Jun 17 15:03:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:03:13.387143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a3fd4-8314-4e28-a230-4f65319e9b8a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:03:13.511224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a3fd4-8314-4e28-a230-4f65319e9b8a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:03:13.554222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e8cbc-1d00-4135-afd8-d9e3243fa8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:03:13.554979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8cbc-1d00-4135-afd8-d9e3243fa8ba None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:03:13.555263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8cbc-1d00-4135-afd8-d9e3243fa8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:03:13.555547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8cbc-1d00-4135-afd8-d9e3243fa8ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:03:13.556349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e8cbc-1d00-4135-afd8-d9e3243fa8ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:03:13.557860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e8cbc-1d00-4135-afd8-d9e3243fa8ba None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:03:13.580992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 666/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 17 15:03:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:03:23.377484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=30 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:23.576163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:19.833020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822d4ef-1016-4311-947f-485824efe1df None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:19.834289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822d4ef-1016-4311-947f-485824efe1df None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:19.834940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822d4ef-1016-4311-947f-485824efe1df None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:19.844670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27741f8-f86f-4315-af57-c347758c6d34 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:19.845157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27741f8-f86f-4315-af57-c347758c6d34 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:19.845421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27741f8-f86f-4315-af57-c347758c6d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:19.848474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 641/1307] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:19 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:19.992639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b27741f8-f86f-4315-af57-c347758c6d34 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:19.993962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b27741f8-f86f-4315-af57-c347758c6d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:20.118916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 667/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:20.168487 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62005b-a319-4162-a232-cd97d6425c46 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:20.168744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62005b-a319-4162-a232-cd97d6425c46 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:20.169313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62005b-a319-4162-a232-cd97d6425c46 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:20.170653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 642/1309] 10.222.0.45 () {54 vars in 964 bytes} [Fri Jun 17 15:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:20.177008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c3c8c-630e-42dd-b2f5-5f431ec9d637 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:20.177629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c3c8c-630e-42dd-b2f5-5f431ec9d637 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:20.178096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c3c8c-630e-42dd-b2f5-5f431ec9d637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:20.260809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ca9c3c8c-630e-42dd-b2f5-5f431ec9d637 None None] MFA Rules not processed for user `20745118f9eb436096a323ba2d22e94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:20.262059 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ca9c3c8c-630e-42dd-b2f5-5f431ec9d637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:20.287345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:20.351849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 668/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Fri Jun 17 15:04:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:20.360987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62005b-a319-4162-a232-cd97d6425c46 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:20.362771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0d62005b-a319-4162-a232-cd97d6425c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:20.490714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62005b-a319-4162-a232-cd97d6425c46 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:20.577131 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4b289-a005-4bdc-95aa-48d79aaf18da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:20.577833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4b289-a005-4bdc-95aa-48d79aaf18da service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:20.578137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4b289-a005-4bdc-95aa-48d79aaf18da service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:20.578509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4b289-a005-4bdc-95aa-48d79aaf18da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:20.580412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a2a4b289-a005-4bdc-95aa-48d79aaf18da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:20.642009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:20.721093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4b289-a005-4bdc-95aa-48d79aaf18da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:20.722614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4b289-a005-4bdc-95aa-48d79aaf18da service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:20.745925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 643/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:23.290141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c851dd7-6806-496b-a6fe-13be40e0fe2c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:23.290697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c851dd7-6806-496b-a6fe-13be40e0fe2c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:23.290697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c851dd7-6806-496b-a6fe-13be40e0fe2c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:23.292425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 669/1312] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:23.298092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61274db4-4a9e-4362-88c7-40feae66c6b0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:23.298617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61274db4-4a9e-4362-88c7-40feae66c6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:23.298617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61274db4-4a9e-4362-88c7-40feae66c6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:23.380524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-61274db4-4a9e-4362-88c7-40feae66c6b0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:23.381671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-61274db4-4a9e-4362-88c7-40feae66c6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:23.505276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 644/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:23.545116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c851dd7-6806-496b-a6fe-13be40e0fe2c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:23.547799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1c851dd7-6806-496b-a6fe-13be40e0fe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:23.678983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c851dd7-6806-496b-a6fe-13be40e0fe2c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:23.763232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:23.766099 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a713ba0-10ba-436c-997c-b6917719e32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:23.766777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a713ba0-10ba-436c-997c-b6917719e32d service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:23.767063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a713ba0-10ba-436c-997c-b6917719e32d service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:23.767343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a713ba0-10ba-436c-997c-b6917719e32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:23.769708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3a713ba0-10ba-436c-997c-b6917719e32d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:23.901346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a713ba0-10ba-436c-997c-b6917719e32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:23.903031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a713ba0-10ba-436c-997c-b6917719e32d service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:23.923635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 670/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:26.373951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f2d8c-fb7c-4ef4-953f-f233e97fbd99 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:26.374811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f2d8c-fb7c-4ef4-953f-f233e97fbd99 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:26.374811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f2d8c-fb7c-4ef4-953f-f233e97fbd99 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:26.375924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 645/1315] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:26.381407 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d59ae5-74ec-450d-8664-8815a2072921 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:26.381885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d59ae5-74ec-450d-8664-8815a2072921 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:26.381993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d59ae5-74ec-450d-8664-8815a2072921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:26.449127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f1d59ae5-74ec-450d-8664-8815a2072921 None None] MFA Rules not processed for user `9d87e4186e5d4797a064a0e3092c629d`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:26.450423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f1d59ae5-74ec-450d-8664-8815a2072921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:26.512823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:26.569925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 671/1316] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:04:26.613394 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f2d8c-fb7c-4ef4-953f-f233e97fbd99 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:26.614960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2b9f2d8c-fb7c-4ef4-953f-f233e97fbd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:26.629650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:26.734843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f2d8c-fb7c-4ef4-953f-f233e97fbd99 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:26.823717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d67759-db31-4269-9595-026a69aaca33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:26.824375 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d67759-db31-4269-9595-026a69aaca33 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:26.824653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d67759-db31-4269-9595-026a69aaca33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:26.824922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d67759-db31-4269-9595-026a69aaca33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:26.826603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f2d67759-db31-4269-9595-026a69aaca33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:26.892029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:26.947387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d67759-db31-4269-9595-026a69aaca33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:26.948854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d67759-db31-4269-9595-026a69aaca33 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:26.969638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 646/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:29.716788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354d5e-d366-47c0-83f9-a375ae5963e1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:29.717659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354d5e-d366-47c0-83f9-a375ae5963e1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:29.717798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354d5e-d366-47c0-83f9-a375ae5963e1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:29.720044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 672/1318] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:29.726396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ffb81-4c6f-40b7-9a50-570c5afb0b0d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:29.727172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ffb81-4c6f-40b7-9a50-570c5afb0b0d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:29.727307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ffb81-4c6f-40b7-9a50-570c5afb0b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:29.806350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8a5ffb81-4c6f-40b7-9a50-570c5afb0b0d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:29.807595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8a5ffb81-4c6f-40b7-9a50-570c5afb0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:29.916034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 647/1319] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:29.957599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9354d5e-d366-47c0-83f9-a375ae5963e1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:29.959135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b9354d5e-d366-47c0-83f9-a375ae5963e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:30.067777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9354d5e-d366-47c0-83f9-a375ae5963e1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:30.147037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45949ef9-df9d-43cc-b605-d06feba92b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:30.147668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949ef9-df9d-43cc-b605-d06feba92b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:30.147947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949ef9-df9d-43cc-b605-d06feba92b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:30.148217 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949ef9-df9d-43cc-b605-d06feba92b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:30.149866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-45949ef9-df9d-43cc-b605-d06feba92b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:30.157278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:30.275749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45949ef9-df9d-43cc-b605-d06feba92b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:30.277171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45949ef9-df9d-43cc-b605-d06feba92b4f service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:30.304536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 673/1320] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:33.251453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb03e4-b916-411d-acea-ee49bd250dca None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:33.252034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb03e4-b916-411d-acea-ee49bd250dca None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:33.252034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb03e4-b916-411d-acea-ee49bd250dca None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:33.253710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 648/1321] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:33.259494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd503-e17f-4d47-951d-090432e51d04 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:33.260000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd503-e17f-4d47-951d-090432e51d04 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:33.260106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd503-e17f-4d47-951d-090432e51d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:33.334146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e7dcd503-e17f-4d47-951d-090432e51d04 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:33.335420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e7dcd503-e17f-4d47-951d-090432e51d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:33.415478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:33.462231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 674/1322] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:04:33.514401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688aec1b-c151-45e1-bc9b-175eceaa5117 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:33.514783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688aec1b-c151-45e1-bc9b-175eceaa5117 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:33.515038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688aec1b-c151-45e1-bc9b-175eceaa5117 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:33.516462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 649/1323] 10.222.0.45 () {54 vars in 964 bytes} [Fri Jun 17 15:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:33.523433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072df67-49d2-4ac0-9964-7c49e17d28f2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:33.523729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072df67-49d2-4ac0-9964-7c49e17d28f2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:33.523988 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072df67-49d2-4ac0-9964-7c49e17d28f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:33.605453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8072df67-49d2-4ac0-9964-7c49e17d28f2 None None] MFA Rules not processed for user `20745118f9eb436096a323ba2d22e94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:33.606661 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8072df67-49d2-4ac0-9964-7c49e17d28f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:33.695235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 675/1324] 10.222.0.45 () {58 vars in 1061 bytes} [Fri Jun 17 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:33.708127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688aec1b-c151-45e1-bc9b-175eceaa5117 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:33.710487 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-688aec1b-c151-45e1-bc9b-175eceaa5117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:33.738452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:33.836159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688aec1b-c151-45e1-bc9b-175eceaa5117 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:33.917025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782110c-f32b-4115-8105-04291eaafcf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:33.917707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782110c-f32b-4115-8105-04291eaafcf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:33.917983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782110c-f32b-4115-8105-04291eaafcf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:33.918253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782110c-f32b-4115-8105-04291eaafcf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:33.919909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5782110c-f32b-4115-8105-04291eaafcf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:34.001387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:34.048157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782110c-f32b-4115-8105-04291eaafcf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:34.049563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782110c-f32b-4115-8105-04291eaafcf8 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:34.070125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 650/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:36.486842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c40d4-f3bf-473b-adad-4dc53ccf998f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:36.487406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c40d4-f3bf-473b-adad-4dc53ccf998f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:36.487406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c40d4-f3bf-473b-adad-4dc53ccf998f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:36.488804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 676/1326] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:36.494455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d903f22-9b2c-41fa-9c2c-0b25058f1635 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:36.494983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d903f22-9b2c-41fa-9c2c-0b25058f1635 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:36.495090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d903f22-9b2c-41fa-9c2c-0b25058f1635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:36.580880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9d903f22-9b2c-41fa-9c2c-0b25058f1635 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:36.581630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9d903f22-9b2c-41fa-9c2c-0b25058f1635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:36.684288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 651/1327] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:36.724650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c40d4-f3bf-473b-adad-4dc53ccf998f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:36.726316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ff9c40d4-f3bf-473b-adad-4dc53ccf998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:36.798894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:36.846869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c40d4-f3bf-473b-adad-4dc53ccf998f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:36.923663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f97ee-0799-491f-8bef-3dadc69c1d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:36.924321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f97ee-0799-491f-8bef-3dadc69c1d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:36.924602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f97ee-0799-491f-8bef-3dadc69c1d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:36.924878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f97ee-0799-491f-8bef-3dadc69c1d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:36.927237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0f6f97ee-0799-491f-8bef-3dadc69c1d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:37.039181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:37.042032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f97ee-0799-491f-8bef-3dadc69c1d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:37.043687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f97ee-0799-491f-8bef-3dadc69c1d46 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:37.063931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 677/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:39.246501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35860bb3-9cfa-41b2-8abf-a94d9b340329 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:39.247054 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35860bb3-9cfa-41b2-8abf-a94d9b340329 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:39.247054 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35860bb3-9cfa-41b2-8abf-a94d9b340329 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:39.248331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 652/1329] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:39.253589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838ca1-c248-4048-a736-c495338242c9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:39.254037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838ca1-c248-4048-a736-c495338242c9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:39.254127 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838ca1-c248-4048-a736-c495338242c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:39.320705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3d838ca1-c248-4048-a736-c495338242c9 None None] MFA Rules not processed for user `9d87e4186e5d4797a064a0e3092c629d`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:39.321956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3d838ca1-c248-4048-a736-c495338242c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:39.426203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 678/1330] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:39.465028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35860bb3-9cfa-41b2-8abf-a94d9b340329 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:39.466595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-35860bb3-9cfa-41b2-8abf-a94d9b340329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:39.499891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:39.575263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35860bb3-9cfa-41b2-8abf-a94d9b340329 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:39.649364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed7cd7-6fb2-42e4-8a3d-27756f0ce95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:39.650018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7cd7-6fb2-42e4-8a3d-27756f0ce95d service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:39.650298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7cd7-6fb2-42e4-8a3d-27756f0ce95d service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:39.650571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7cd7-6fb2-42e4-8a3d-27756f0ce95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:39.652219 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-96ed7cd7-6fb2-42e4-8a3d-27756f0ce95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:39.742742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:39.783408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed7cd7-6fb2-42e4-8a3d-27756f0ce95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:39.784893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed7cd7-6fb2-42e4-8a3d-27756f0ce95d service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:39.807829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 653/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:42.307149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87fd19-6df5-49e6-9d0d-cb3171544979 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:42.307778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87fd19-6df5-49e6-9d0d-cb3171544979 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:42.307778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87fd19-6df5-49e6-9d0d-cb3171544979 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:42.309793 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 679/1332] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:42.316368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dafd2-d0af-4167-b103-f45c09ebbb7d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:42.316862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dafd2-d0af-4167-b103-f45c09ebbb7d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:42.316957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dafd2-d0af-4167-b103-f45c09ebbb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:42.397186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0e0dafd2-d0af-4167-b103-f45c09ebbb7d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:42.398457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0e0dafd2-d0af-4167-b103-f45c09ebbb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:42.508467 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 654/1333] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:42.547628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87fd19-6df5-49e6-9d0d-cb3171544979 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:42.549275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dc87fd19-6df5-49e6-9d0d-cb3171544979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:42.641422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:42.678140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87fd19-6df5-49e6-9d0d-cb3171544979 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:42.757238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab71de8-ed0c-4d8f-97fc-7892a7b9713a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:42.757891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71de8-ed0c-4d8f-97fc-7892a7b9713a service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:42.758175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71de8-ed0c-4d8f-97fc-7892a7b9713a service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:42.758439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71de8-ed0c-4d8f-97fc-7892a7b9713a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:42.760091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2ab71de8-ed0c-4d8f-97fc-7892a7b9713a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:42.879142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab71de8-ed0c-4d8f-97fc-7892a7b9713a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:42.880923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab71de8-ed0c-4d8f-97fc-7892a7b9713a service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:42.893827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:42.903206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 680/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:45.148403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a36772-1960-49b5-b7a9-45cacb6ed5df None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:45.149002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a36772-1960-49b5-b7a9-45cacb6ed5df None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:45.149002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a36772-1960-49b5-b7a9-45cacb6ed5df None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:45.150277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 655/1335] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:45.156199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadca52-52b7-4da5-bebc-ec09fddc863e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:45.156672 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadca52-52b7-4da5-bebc-ec09fddc863e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:45.156787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadca52-52b7-4da5-bebc-ec09fddc863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:45.223222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fbadca52-52b7-4da5-bebc-ec09fddc863e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:45.224418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fbadca52-52b7-4da5-bebc-ec09fddc863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:45.330444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 681/1336] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:45.370136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a36772-1960-49b5-b7a9-45cacb6ed5df None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:45.371684 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d9a36772-1960-49b5-b7a9-45cacb6ed5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:45.414062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:45.481680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a36772-1960-49b5-b7a9-45cacb6ed5df None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:45.560221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574c13b-b4b2-4485-aa46-a92ba223e35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:45.560867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574c13b-b4b2-4485-aa46-a92ba223e35d service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:45.561329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574c13b-b4b2-4485-aa46-a92ba223e35d service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:45.561914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574c13b-b4b2-4485-aa46-a92ba223e35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:45.563589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e574c13b-b4b2-4485-aa46-a92ba223e35d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:45.653802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:45.681919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574c13b-b4b2-4485-aa46-a92ba223e35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:45.683296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574c13b-b4b2-4485-aa46-a92ba223e35d service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:45.703166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 656/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:48.136129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f6919-2f05-4cea-affa-731b887965bd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:48.136760 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f6919-2f05-4cea-affa-731b887965bd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:48.136760 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f6919-2f05-4cea-affa-731b887965bd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:48.138196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 682/1338] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:48.143942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e7a99-70db-4bba-b4de-4531cec7e122 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:48.144420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e7a99-70db-4bba-b4de-4531cec7e122 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:48.144516 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e7a99-70db-4bba-b4de-4531cec7e122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:48.214763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f24e7a99-70db-4bba-b4de-4531cec7e122 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:48.215988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f24e7a99-70db-4bba-b4de-4531cec7e122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:48.322272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 657/1339] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:48.359752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f6919-2f05-4cea-affa-731b887965bd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:48.361330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-515f6919-2f05-4cea-affa-731b887965bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:48.448457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:48.481346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f6919-2f05-4cea-affa-731b887965bd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:48.560274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e1a1d-525a-4c7b-b9f3-66cbd7c026b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:48.560937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e1a1d-525a-4c7b-b9f3-66cbd7c026b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:48.561231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e1a1d-525a-4c7b-b9f3-66cbd7c026b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:48.561542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e1a1d-525a-4c7b-b9f3-66cbd7c026b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:48.563367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-aa3e1a1d-525a-4c7b-b9f3-66cbd7c026b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:48.679099 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e1a1d-525a-4c7b-b9f3-66cbd7c026b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:48.680544 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e1a1d-525a-4c7b-b9f3-66cbd7c026b7 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:48.701191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 683/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:04:52.831539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799843-62da-4dc8-9edb-a43021a049d8 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:52.832101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799843-62da-4dc8-9edb-a43021a049d8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:52.832101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799843-62da-4dc8-9edb-a43021a049d8 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:52.833475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 658/1341] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:52.838747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0776112-3c15-4b7c-800a-c8c9b4c6626f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:52.839173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0776112-3c15-4b7c-800a-c8c9b4c6626f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:52.839284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0776112-3c15-4b7c-800a-c8c9b4c6626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:52.845994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:52.915732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c0776112-3c15-4b7c-800a-c8c9b4c6626f None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:52.916872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c0776112-3c15-4b7c-800a-c8c9b4c6626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:53.033789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 684/1342] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:53.073380 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799843-62da-4dc8-9edb-a43021a049d8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:53.075745 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fa799843-62da-4dc8-9edb-a43021a049d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:53.129802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:53.179259 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799843-62da-4dc8-9edb-a43021a049d8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:53.183447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2439e-1f07-4c82-a8ae-a5752cf8ca33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:53.184172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2439e-1f07-4c82-a8ae-a5752cf8ca33 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:53.184449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2439e-1f07-4c82-a8ae-a5752cf8ca33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:53.184719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2439e-1f07-4c82-a8ae-a5752cf8ca33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:53.195213 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2439e-1f07-4c82-a8ae-a5752cf8ca33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:53.196647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2439e-1f07-4c82-a8ae-a5752cf8ca33 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:53.207710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 659/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:56.058744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a5a0-373b-49d6-a228-07eb1be0f9c5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:56.059335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a5a0-373b-49d6-a228-07eb1be0f9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:56.059335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a5a0-373b-49d6-a228-07eb1be0f9c5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:56.060667 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 685/1344] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:04:56.066653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa766ebc-35c1-4532-98ab-54847ef1da04 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:56.067246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa766ebc-35c1-4532-98ab-54847ef1da04 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:56.067246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa766ebc-35c1-4532-98ab-54847ef1da04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:56.102035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-aa766ebc-35c1-4532-98ab-54847ef1da04 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:04:56.103525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aa766ebc-35c1-4532-98ab-54847ef1da04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:04:56.210419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 660/1345] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:04:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:04:56.251531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344a5a0-373b-49d6-a228-07eb1be0f9c5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:04:56.263940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344a5a0-373b-49d6-a228-07eb1be0f9c5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:04:56.268396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c33acf-a83b-441d-818d-e8850674099a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:04:56.269045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c33acf-a83b-441d-818d-e8850674099a service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:04:56.269359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c33acf-a83b-441d-818d-e8850674099a service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:04:56.269631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c33acf-a83b-441d-818d-e8850674099a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:04:56.279094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c33acf-a83b-441d-818d-e8850674099a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:04:56.280564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c33acf-a83b-441d-818d-e8850674099a service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:04:56.290524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 686/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:04:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:00.548503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50664-4803-4934-8dbe-237a1020e777 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:00.549065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50664-4803-4934-8dbe-237a1020e777 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:00.549065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50664-4803-4934-8dbe-237a1020e777 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:00.550647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 661/1347] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:00.556100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30526f-bbb6-4be0-ac8d-620a63ac5020 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:00.556550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30526f-bbb6-4be0-ac8d-620a63ac5020 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:00.556655 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30526f-bbb6-4be0-ac8d-620a63ac5020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:00.576182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3d30526f-bbb6-4be0-ac8d-620a63ac5020 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:00.577537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3d30526f-bbb6-4be0-ac8d-620a63ac5020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:00.586996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 687/1348] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:00.625032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50664-4803-4934-8dbe-237a1020e777 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:00.636094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50664-4803-4934-8dbe-237a1020e777 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:00.641034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd6418-6860-497a-87ca-b59d1c1b37eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:00.641964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd6418-6860-497a-87ca-b59d1c1b37eb service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:00.642276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd6418-6860-497a-87ca-b59d1c1b37eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:00.642581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd6418-6860-497a-87ca-b59d1c1b37eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:00.652471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd6418-6860-497a-87ca-b59d1c1b37eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:00.654046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd6418-6860-497a-87ca-b59d1c1b37eb service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:00.664615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 662/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:05.753526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8039-75bc-4270-9211-1d113ed83d30 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:05.754446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8039-75bc-4270-9211-1d113ed83d30 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:05.754933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8039-75bc-4270-9211-1d113ed83d30 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:05.756829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 688/1350] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:05.764307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9deb0-fdd4-4dab-9427-08c395ed7e33 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:05.764753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9deb0-fdd4-4dab-9427-08c395ed7e33 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:05.764858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9deb0-fdd4-4dab-9427-08c395ed7e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:05.857276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e3b9deb0-fdd4-4dab-9427-08c395ed7e33 None None] MFA Rules not processed for user `328d0413dc65420c841b452f45c5b0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:05.859828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e3b9deb0-fdd4-4dab-9427-08c395ed7e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:05.895879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:05:06.013673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 663/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:05:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:10.570044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=72 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:05:10.751499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88680be-5cda-41e6-b978-bf919467a8dd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:10.751897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88680be-5cda-41e6-b978-bf919467a8dd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:10.752120 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88680be-5cda-41e6-b978-bf919467a8dd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:10.754394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 689/1352] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:10.759800 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbc286-5b5c-4c2c-b933-a1685bc81f33 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:10.760304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbc286-5b5c-4c2c-b933-a1685bc81f33 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:10.760482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbc286-5b5c-4c2c-b933-a1685bc81f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:10.797776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d1cbc286-5b5c-4c2c-b933-a1685bc81f33 None None] MFA Rules not processed for user `328d0413dc65420c841b452f45c5b0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:10.800128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1cbc286-5b5c-4c2c-b933-a1685bc81f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:10.813038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 664/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:05:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:12.240472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eee10-a294-4adf-9264-6e87200535ae None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:12.241043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eee10-a294-4adf-9264-6e87200535ae None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:12.241043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eee10-a294-4adf-9264-6e87200535ae None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:12.242399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 690/1354] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:12.247836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903660f8-2b43-4793-b607-d66eda26d16b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:12.248321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903660f8-2b43-4793-b607-d66eda26d16b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:12.248423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903660f8-2b43-4793-b607-d66eda26d16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:12.281127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-903660f8-2b43-4793-b607-d66eda26d16b None None] MFA Rules not processed for user `328d0413dc65420c841b452f45c5b0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:12.282442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-903660f8-2b43-4793-b607-d66eda26d16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:12.291437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 665/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:05:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:16.312827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c126-7800-4727-972f-834341fb8819 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:16.313871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c126-7800-4727-972f-834341fb8819 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:16.314361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c126-7800-4727-972f-834341fb8819 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:16.321260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 691/1356] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:16.322205 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462285bf-56a1-47ea-9908-024462c46f60 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:16.322636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462285bf-56a1-47ea-9908-024462c46f60 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:16.322795 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462285bf-56a1-47ea-9908-024462c46f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:16.354162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-462285bf-56a1-47ea-9908-024462c46f60 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:16.355390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-462285bf-56a1-47ea-9908-024462c46f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:16.368445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 666/1357] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:16.431279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf086d-32e4-4a6a-bc03-7190c4805d09 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:16.431901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf086d-32e4-4a6a-bc03-7190c4805d09 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:16.432396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf086d-32e4-4a6a-bc03-7190c4805d09 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:16.434351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 692/1358] 10.222.0.45 () {54 vars in 961 bytes} [Fri Jun 17 15:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:16.446281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10b4d-4654-4869-85dd-2fbd85e1f31b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:16.446565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10b4d-4654-4869-85dd-2fbd85e1f31b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:16.446828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10b4d-4654-4869-85dd-2fbd85e1f31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:16.526170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-94a10b4d-4654-4869-85dd-2fbd85e1f31b None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:16.527382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-94a10b4d-4654-4869-85dd-2fbd85e1f31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:16.656678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 667/1359] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Jun 17 15:05:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:16.664879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf086d-32e4-4a6a-bc03-7190c4805d09 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:16.682565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf086d-32e4-4a6a-bc03-7190c4805d09 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:16.690675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db1369-d1aa-4b1d-a0f2-092e85a2763f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:16.691451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1369-d1aa-4b1d-a0f2-092e85a2763f service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:16.692053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1369-d1aa-4b1d-a0f2-092e85a2763f service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:16.692574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1369-d1aa-4b1d-a0f2-092e85a2763f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:16.703448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db1369-d1aa-4b1d-a0f2-092e85a2763f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:16.705907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db1369-d1aa-4b1d-a0f2-092e85a2763f service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:16.717535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 693/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:19.198151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a76252-453a-4838-b3eb-8474742df92e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:19.198770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a76252-453a-4838-b3eb-8474742df92e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:19.198770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a76252-453a-4838-b3eb-8474742df92e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:19.200417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 668/1361] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:19.206871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c09a-efec-4c6a-9420-80f4ffb9f53a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:19.207529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c09a-efec-4c6a-9420-80f4ffb9f53a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:19.207529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c09a-efec-4c6a-9420-80f4ffb9f53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:19.228291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5e59c09a-efec-4c6a-9420-80f4ffb9f53a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:19.230328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5e59c09a-efec-4c6a-9420-80f4ffb9f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:19.242248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 694/1362] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:05:19.291275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a76252-453a-4838-b3eb-8474742df92e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:19.307074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a76252-453a-4838-b3eb-8474742df92e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:19.313417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45462-d3ff-4c7c-951b-7a271998023c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:19.314151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45462-d3ff-4c7c-951b-7a271998023c service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:19.314495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45462-d3ff-4c7c-951b-7a271998023c service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:19.314834 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45462-d3ff-4c7c-951b-7a271998023c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:19.325444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a45462-d3ff-4c7c-951b-7a271998023c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:19.327344 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a45462-d3ff-4c7c-951b-7a271998023c service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:19.339828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 669/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:21.934064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608041b-36ad-4654-9d0a-6ce6bf71872b None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:21.934601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608041b-36ad-4654-9d0a-6ce6bf71872b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:21.934601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608041b-36ad-4654-9d0a-6ce6bf71872b None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:21.935899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 695/1364] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:21.943099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ea05-b073-43ba-83cd-8c51384bb0f8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:21.943658 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ea05-b073-43ba-83cd-8c51384bb0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:21.943798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ea05-b073-43ba-83cd-8c51384bb0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:21.966327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fd87ea05-b073-43ba-83cd-8c51384bb0f8 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:21.966327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fd87ea05-b073-43ba-83cd-8c51384bb0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:21.975429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 670/1365] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:22.025535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996bac3-45de-4290-ab6d-311595e45e67 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:22.025535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996bac3-45de-4290-ab6d-311595e45e67 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:22.025535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996bac3-45de-4290-ab6d-311595e45e67 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:22.030372 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 696/1366] 10.222.0.45 () {54 vars in 961 bytes} [Fri Jun 17 15:05:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:22.036599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490acfe1-1164-4e97-a67f-38a1058a09c2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:22.037034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490acfe1-1164-4e97-a67f-38a1058a09c2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:22.037490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490acfe1-1164-4e97-a67f-38a1058a09c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:22.060806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-490acfe1-1164-4e97-a67f-38a1058a09c2 None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:22.062066 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-490acfe1-1164-4e97-a67f-38a1058a09c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:22.073828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 671/1367] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Jun 17 15:05:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:22.082104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996bac3-45de-4290-ab6d-311595e45e67 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:22.097847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996bac3-45de-4290-ab6d-311595e45e67 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:22.110638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b7800-96ff-4a35-9ea6-96cb8b4a4fcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:22.111264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b7800-96ff-4a35-9ea6-96cb8b4a4fcd service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:22.111530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b7800-96ff-4a35-9ea6-96cb8b4a4fcd service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:22.111802 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b7800-96ff-4a35-9ea6-96cb8b4a4fcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:22.121869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b7800-96ff-4a35-9ea6-96cb8b4a4fcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:22.123800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b7800-96ff-4a35-9ea6-96cb8b4a4fcd service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:22.135617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 697/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:24.423253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a5e25-95f4-474d-83e3-79ccfb6d6d08 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:24.424329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a5e25-95f4-474d-83e3-79ccfb6d6d08 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:24.424862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a5e25-95f4-474d-83e3-79ccfb6d6d08 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:24.426626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 672/1369] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:24.434138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc7a5-3c26-47ea-9bd7-22a32c7f4a56 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:24.435131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc7a5-3c26-47ea-9bd7-22a32c7f4a56 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:24.435624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc7a5-3c26-47ea-9bd7-22a32c7f4a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:24.456495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-54fcc7a5-3c26-47ea-9bd7-22a32c7f4a56 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:24.457730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-54fcc7a5-3c26-47ea-9bd7-22a32c7f4a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:24.467413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 698/1370] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:24.518208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a5e25-95f4-474d-83e3-79ccfb6d6d08 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:24.540535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a5e25-95f4-474d-83e3-79ccfb6d6d08 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:24.548346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276740-e84a-42b3-b579-545a6dd2d1c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:24.549422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276740-e84a-42b3-b579-545a6dd2d1c7 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:24.549949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276740-e84a-42b3-b579-545a6dd2d1c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:24.550431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276740-e84a-42b3-b579-545a6dd2d1c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:24.563250 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73276740-e84a-42b3-b579-545a6dd2d1c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:24.566224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73276740-e84a-42b3-b579-545a6dd2d1c7 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:24.580595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 673/1371] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:25.034931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94618afa-cd54-476c-b4c3-77696af8533b None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:25.035264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94618afa-cd54-476c-b4c3-77696af8533b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:25.035449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94618afa-cd54-476c-b4c3-77696af8533b None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:25.041090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 699/1372] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:25.043226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f886f70-51d6-494c-88c6-4186e9797e93 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:25.043572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f886f70-51d6-494c-88c6-4186e9797e93 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:25.043913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f886f70-51d6-494c-88c6-4186e9797e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:25.065248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7f886f70-51d6-494c-88c6-4186e9797e93 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:25.066613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7f886f70-51d6-494c-88c6-4186e9797e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:25.076621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 674/1373] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:25.380313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80eb1f-43fc-4269-8608-03fc6607bb34 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:25.380313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80eb1f-43fc-4269-8608-03fc6607bb34 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:25.380313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80eb1f-43fc-4269-8608-03fc6607bb34 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:25.383458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 700/1374] 10.222.0.45 () {54 vars in 963 bytes} [Fri Jun 17 15:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:25.386505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f06e0c-bc09-40f1-b721-a524b864cd6d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:25.386796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f06e0c-bc09-40f1-b721-a524b864cd6d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:25.387077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f06e0c-bc09-40f1-b721-a524b864cd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:25.394061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:05:25.453951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-58f06e0c-bc09-40f1-b721-a524b864cd6d None None] MFA Rules not processed for user `b9cc8b94e9ba470ca1f620b7cbed8e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:25.455712 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58f06e0c-bc09-40f1-b721-a524b864cd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:25.528304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 675/1375] 10.222.0.45 () {58 vars in 1060 bytes} [Fri Jun 17 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:25.536998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80eb1f-43fc-4269-8608-03fc6607bb34 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:25.553849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80eb1f-43fc-4269-8608-03fc6607bb34 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:25.558349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cf35f-7ca7-4a81-95fa-b9343927df88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:25.559082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf35f-7ca7-4a81-95fa-b9343927df88 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:25.559476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf35f-7ca7-4a81-95fa-b9343927df88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:25.559826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf35f-7ca7-4a81-95fa-b9343927df88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:25.571836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cf35f-7ca7-4a81-95fa-b9343927df88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:25.573649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cf35f-7ca7-4a81-95fa-b9343927df88 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:25.585516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 701/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:26.902076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7b3f1-d8b9-4bdf-b737-4894d1f0f31c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:26.902649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7b3f1-d8b9-4bdf-b737-4894d1f0f31c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:26.902649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7b3f1-d8b9-4bdf-b737-4894d1f0f31c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:26.904019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 676/1377] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:26.911112 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e069db-47c7-4fc3-956e-0b379d5e4704 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:26.911649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e069db-47c7-4fc3-956e-0b379d5e4704 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:26.911649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e069db-47c7-4fc3-956e-0b379d5e4704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:26.939951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-27e069db-47c7-4fc3-956e-0b379d5e4704 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:26.941891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-27e069db-47c7-4fc3-956e-0b379d5e4704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:26.955414 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 702/1378] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:27.003572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7b3f1-d8b9-4bdf-b737-4894d1f0f31c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:27.023289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7b3f1-d8b9-4bdf-b737-4894d1f0f31c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:27.029869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534dab3-e24f-4b1d-aa3f-23d2f5f8d163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:27.030528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534dab3-e24f-4b1d-aa3f-23d2f5f8d163 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:27.030798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534dab3-e24f-4b1d-aa3f-23d2f5f8d163 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:27.031073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534dab3-e24f-4b1d-aa3f-23d2f5f8d163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:27.040555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534dab3-e24f-4b1d-aa3f-23d2f5f8d163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:27.042261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534dab3-e24f-4b1d-aa3f-23d2f5f8d163 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:27.059179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 677/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:29.374108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05353ca-4145-4104-8bef-df998fefbd22 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:29.374647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05353ca-4145-4104-8bef-df998fefbd22 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:29.374924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05353ca-4145-4104-8bef-df998fefbd22 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:29.377005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 703/1380] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:29.383245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b966-a3d6-4c5f-bfba-0cdd68eacccf None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:29.383767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b966-a3d6-4c5f-bfba-0cdd68eacccf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:29.383767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b966-a3d6-4c5f-bfba-0cdd68eacccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:29.410996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cae4b966-a3d6-4c5f-bfba-0cdd68eacccf None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:29.412471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cae4b966-a3d6-4c5f-bfba-0cdd68eacccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:29.429415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 678/1381] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:29.471429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05353ca-4145-4104-8bef-df998fefbd22 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:29.493792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05353ca-4145-4104-8bef-df998fefbd22 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:29.501725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f48aae-1706-49b2-9193-3574f95652f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:29.502571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f48aae-1706-49b2-9193-3574f95652f2 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:29.503026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f48aae-1706-49b2-9193-3574f95652f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:29.503578 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f48aae-1706-49b2-9193-3574f95652f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:29.514941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f48aae-1706-49b2-9193-3574f95652f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:29.517979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f48aae-1706-49b2-9193-3574f95652f2 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:29.535471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 704/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:31.830421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d432ed-a8de-4343-80a9-00033f74f5d0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:31.831623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d432ed-a8de-4343-80a9-00033f74f5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:31.831995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d432ed-a8de-4343-80a9-00033f74f5d0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:31.833649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 679/1383] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:31.843135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24df12-1519-4321-a813-17c873bc3ac4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:31.843135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24df12-1519-4321-a813-17c873bc3ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:31.843135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24df12-1519-4321-a813-17c873bc3ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:31.862342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5d24df12-1519-4321-a813-17c873bc3ac4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:31.863723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5d24df12-1519-4321-a813-17c873bc3ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:31.873468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 705/1384] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:05:31.917461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d432ed-a8de-4343-80a9-00033f74f5d0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:31.936045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d432ed-a8de-4343-80a9-00033f74f5d0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:31.942322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb9bec-b5ac-489f-9585-598da3835822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:31.943030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb9bec-b5ac-489f-9585-598da3835822 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:31.943314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb9bec-b5ac-489f-9585-598da3835822 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:31.943568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb9bec-b5ac-489f-9585-598da3835822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:31.955204 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb9bec-b5ac-489f-9585-598da3835822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:31.957198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb9bec-b5ac-489f-9585-598da3835822 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:31.978655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 680/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:34.217323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef8fc-5924-4f03-af60-50fdafb89064 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:34.218026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef8fc-5924-4f03-af60-50fdafb89064 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:34.218026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef8fc-5924-4f03-af60-50fdafb89064 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:34.219437 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 706/1386] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:34.227634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce3a7-cde5-4593-b188-8acde715094f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:34.228479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce3a7-cde5-4593-b188-8acde715094f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:34.228479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce3a7-cde5-4593-b188-8acde715094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:34.250102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-12fce3a7-cde5-4593-b188-8acde715094f None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:34.252149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-12fce3a7-cde5-4593-b188-8acde715094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:34.262290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 681/1387] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:34.320389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddef8fc-5924-4f03-af60-50fdafb89064 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:34.340644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddef8fc-5924-4f03-af60-50fdafb89064 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:34.348360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc1aab-b0e5-42ad-ac8b-fb9a709b2006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:34.349241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc1aab-b0e5-42ad-ac8b-fb9a709b2006 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:34.349636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc1aab-b0e5-42ad-ac8b-fb9a709b2006 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:34.350027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc1aab-b0e5-42ad-ac8b-fb9a709b2006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:34.362717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc1aab-b0e5-42ad-ac8b-fb9a709b2006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:34.364353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc1aab-b0e5-42ad-ac8b-fb9a709b2006 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:34.375569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 707/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:36.747438 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecf8aa-cf3e-4b66-9886-8d3bd6b94236 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:36.748175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecf8aa-cf3e-4b66-9886-8d3bd6b94236 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:36.748175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecf8aa-cf3e-4b66-9886-8d3bd6b94236 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:36.749677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 682/1389] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:36.756524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e282b-53e1-46c8-a509-b6140c94912e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:36.757072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e282b-53e1-46c8-a509-b6140c94912e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:36.757072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e282b-53e1-46c8-a509-b6140c94912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:36.780352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9b0e282b-53e1-46c8-a509-b6140c94912e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:36.782477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9b0e282b-53e1-46c8-a509-b6140c94912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:36.795497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 708/1390] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:36.842569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecf8aa-cf3e-4b66-9886-8d3bd6b94236 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:36.858310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecf8aa-cf3e-4b66-9886-8d3bd6b94236 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:36.864881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc8a18-3191-46d6-b58d-dfa55cc81776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:36.866003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc8a18-3191-46d6-b58d-dfa55cc81776 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:36.866285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc8a18-3191-46d6-b58d-dfa55cc81776 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:36.866576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc8a18-3191-46d6-b58d-dfa55cc81776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:36.877846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc8a18-3191-46d6-b58d-dfa55cc81776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:36.879906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc8a18-3191-46d6-b58d-dfa55cc81776 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:36.896263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 683/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:39.390501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5e299-9085-44dc-a216-59106ef50242 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:39.391049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5e299-9085-44dc-a216-59106ef50242 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:39.391049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5e299-9085-44dc-a216-59106ef50242 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:39.393170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 709/1392] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:39.398880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a8dc6-48e8-44f0-8431-c422a24135db None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:39.399403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a8dc6-48e8-44f0-8431-c422a24135db None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:39.399403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a8dc6-48e8-44f0-8431-c422a24135db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:39.422352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2e7a8dc6-48e8-44f0-8431-c422a24135db None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:39.423685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2e7a8dc6-48e8-44f0-8431-c422a24135db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:39.432308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 684/1393] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:39.478373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5e299-9085-44dc-a216-59106ef50242 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:39.495003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5e299-9085-44dc-a216-59106ef50242 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:39.502097 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed73dff-aa32-4791-9656-1b548fd35f30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:39.502770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73dff-aa32-4791-9656-1b548fd35f30 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:39.503051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73dff-aa32-4791-9656-1b548fd35f30 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:39.503331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73dff-aa32-4791-9656-1b548fd35f30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:39.512892 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed73dff-aa32-4791-9656-1b548fd35f30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:39.514550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed73dff-aa32-4791-9656-1b548fd35f30 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:39.526364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 710/1394] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:05:41.437491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76596238-af10-4fb6-b149-35700a03509e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:41.438101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76596238-af10-4fb6-b149-35700a03509e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:41.438101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76596238-af10-4fb6-b149-35700a03509e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:41.440512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 685/1395] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:41.446686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84a366-9901-4a1f-abbf-c021dda99b5d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:41.447221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84a366-9901-4a1f-abbf-c021dda99b5d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:41.447221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84a366-9901-4a1f-abbf-c021dda99b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:41.454029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=52 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:05:41.467729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2f84a366-9901-4a1f-abbf-c021dda99b5d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:41.468961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2f84a366-9901-4a1f-abbf-c021dda99b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:41.480881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 711/1396] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:41.542452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93a0b1-b90e-41ff-9590-aec58650701e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:41.542753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93a0b1-b90e-41ff-9590-aec58650701e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:41.543009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93a0b1-b90e-41ff-9590-aec58650701e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:41.544611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 686/1397] 10.222.0.45 () {54 vars in 962 bytes} [Fri Jun 17 15:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:41.550304 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aaa3d-0df4-4d6b-850b-5354464aba98 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:41.550755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aaa3d-0df4-4d6b-850b-5354464aba98 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:41.551097 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aaa3d-0df4-4d6b-850b-5354464aba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:41.608199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4d3aaa3d-0df4-4d6b-850b-5354464aba98 None None] MFA Rules not processed for user `d8b74d07fba34715a488539d630b0bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:41.609436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4d3aaa3d-0df4-4d6b-850b-5354464aba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:41.689461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 712/1398] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Jun 17 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:05:41.697894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93a0b1-b90e-41ff-9590-aec58650701e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:41.711966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93a0b1-b90e-41ff-9590-aec58650701e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:41.716613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f59f-1eed-43a2-87f3-5ffe5d9840b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b74d07fba34715a488539d630b0bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:41.717283 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f59f-1eed-43a2-87f3-5ffe5d9840b4 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:41.717586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f59f-1eed-43a2-87f3-5ffe5d9840b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:41.717845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f59f-1eed-43a2-87f3-5ffe5d9840b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:41.729558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f59f-1eed-43a2-87f3-5ffe5d9840b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:41.731838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f59f-1eed-43a2-87f3-5ffe5d9840b4 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:41.741901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e999-f773-49ab-aeac-535dec3ce1a5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:41.742200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e999-f773-49ab-aeac-535dec3ce1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:41.742483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e999-f773-49ab-aeac-535dec3ce1a5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:41.744026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 713/1399] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:05:41.744353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 687/1400] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:41.750244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e5b96-b220-42a4-9a6a-1bef27714907 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:41.750538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e5b96-b220-42a4-9a6a-1bef27714907 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:41.750852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e5b96-b220-42a4-9a6a-1bef27714907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:41.770737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3c1e5b96-b220-42a4-9a6a-1bef27714907 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:41.772001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3c1e5b96-b220-42a4-9a6a-1bef27714907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:41.780383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 714/1401] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:41.828393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f59f-1eed-43a2-87f3-5ffe5d9840b4 service glance] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:41.842354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f59f-1eed-43a2-87f3-5ffe5d9840b4 service glance] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:41.848829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320abee-960a-4a2d-9c9c-002146e5aff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:41.849618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320abee-960a-4a2d-9c9c-002146e5aff5 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:41.849971 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320abee-960a-4a2d-9c9c-002146e5aff5 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:41.850311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320abee-960a-4a2d-9c9c-002146e5aff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:41.860671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320abee-960a-4a2d-9c9c-002146e5aff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:41.862474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320abee-960a-4a2d-9c9c-002146e5aff5 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:41.875369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 688/1402] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:42.540882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eacd9a-1366-40fc-a71d-aa15179a59c8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:42.541493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eacd9a-1366-40fc-a71d-aa15179a59c8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:42.541493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eacd9a-1366-40fc-a71d-aa15179a59c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:42.600812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f6eacd9a-1366-40fc-a71d-aa15179a59c8 None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:42.602074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f6eacd9a-1366-40fc-a71d-aa15179a59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:42.683858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 715/1403] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:05:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:42.726894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893aca0-aaf6-44fe-938c-cffeb0a774fb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:42.727425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893aca0-aaf6-44fe-938c-cffeb0a774fb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:42.727712 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893aca0-aaf6-44fe-938c-cffeb0a774fb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:42.729247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 689/1404] 10.222.0.45 () {54 vars in 942 bytes} [Fri Jun 17 15:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:42.737370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cae43-a3a7-4465-9c9e-383aba93eef7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:42.737870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cae43-a3a7-4465-9c9e-383aba93eef7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:42.738305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cae43-a3a7-4465-9c9e-383aba93eef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:42.806529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d87cae43-a3a7-4465-9c9e-383aba93eef7 None None] MFA Rules not processed for user `34feb70a340c4fc5b1fad510328c009b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:42.807749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d87cae43-a3a7-4465-9c9e-383aba93eef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:42.818174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:05:42.889935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 716/1405] 10.222.0.45 () {58 vars in 1039 bytes} [Fri Jun 17 15:05:42 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:42.899749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893aca0-aaf6-44fe-938c-cffeb0a774fb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:42.914413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893aca0-aaf6-44fe-938c-cffeb0a774fb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:42.919674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3026d9-8af2-4f1f-b9a7-8cb0ab539881 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:42.920331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3026d9-8af2-4f1f-b9a7-8cb0ab539881 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:42.920612 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3026d9-8af2-4f1f-b9a7-8cb0ab539881 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:42.920889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3026d9-8af2-4f1f-b9a7-8cb0ab539881 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:42.933405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3026d9-8af2-4f1f-b9a7-8cb0ab539881 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:42.935080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3026d9-8af2-4f1f-b9a7-8cb0ab539881 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:42.945051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 690/1406] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:05:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:05:44.186204 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56e692-fbd0-4df3-823e-d5381d8255ac None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:44.186764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56e692-fbd0-4df3-823e-d5381d8255ac None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:44.186764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56e692-fbd0-4df3-823e-d5381d8255ac None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:44.188117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 717/1407] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:05:44.194152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41bbe3-94e4-45b9-b082-3d8e47262b80 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:44.195156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41bbe3-94e4-45b9-b082-3d8e47262b80 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:44.195605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41bbe3-94e4-45b9-b082-3d8e47262b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:44.217574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ea41bbe3-94e4-45b9-b082-3d8e47262b80 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:05:44.218936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ea41bbe3-94e4-45b9-b082-3d8e47262b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:05:44.231369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 691/1408] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:05:44.278233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56e692-fbd0-4df3-823e-d5381d8255ac None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:05:44.294014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56e692-fbd0-4df3-823e-d5381d8255ac None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:05:44.300289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e9e69-1713-4ead-95ad-b9219e724de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:05:44.300746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e9e69-1713-4ead-95ad-b9219e724de0 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:05:44.310469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e9e69-1713-4ead-95ad-b9219e724de0 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:05:44.310469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e9e69-1713-4ead-95ad-b9219e724de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:05:44.314332 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e9e69-1713-4ead-95ad-b9219e724de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:05:44.317153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e9e69-1713-4ead-95ad-b9219e724de0 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:05:44.333652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 718/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:05:54.211464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:05:54.326828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=33 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:06:05.891637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080daa0-0fe0-46c6-8856-6dc8247c784c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:05.892231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080daa0-0fe0-46c6-8856-6dc8247c784c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:05.892231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080daa0-0fe0-46c6-8856-6dc8247c784c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:05.893647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 692/1410] 10.222.0.45 () {54 vars in 918 bytes} [Fri Jun 17 15:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:05.898994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db17c-a697-4975-b352-8f34528edcb2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:05.899452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db17c-a697-4975-b352-8f34528edcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:05.899568 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db17c-a697-4975-b352-8f34528edcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:05.918269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ac7db17c-a697-4975-b352-8f34528edcb2 None None] MFA Rules not processed for user `328d0413dc65420c841b452f45c5b0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:05.919463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ac7db17c-a697-4975-b352-8f34528edcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:05.928520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 719/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Jun 17 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:05.943287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4610e1-7a51-44dc-8f42-c0b4da8debd8 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:05.943576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4610e1-7a51-44dc-8f42-c0b4da8debd8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:05.943853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4610e1-7a51-44dc-8f42-c0b4da8debd8 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:05.945235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 693/1412] 10.222.0.45 () {54 vars in 918 bytes} [Fri Jun 17 15:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:05.950489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a221df-3aa7-4429-9eae-6c07ba86a55a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:05.950785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a221df-3aa7-4429-9eae-6c07ba86a55a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:05.951063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a221df-3aa7-4429-9eae-6c07ba86a55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:05.969684 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c4a221df-3aa7-4429-9eae-6c07ba86a55a None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:05.970918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c4a221df-3aa7-4429-9eae-6c07ba86a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:05.980830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 720/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Jun 17 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:08.588954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb696d-e78d-4045-aba3-e3345661d9a0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:08.589623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb696d-e78d-4045-aba3-e3345661d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:08.589623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb696d-e78d-4045-aba3-e3345661d9a0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:08.590885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:08.597582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7a81-1d28-41a2-83be-fcc6222aa967 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:08.598061 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7a81-1d28-41a2-83be-fcc6222aa967 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:08.598172 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7a81-1d28-41a2-83be-fcc6222aa967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:08.616281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-447e7a81-1d28-41a2-83be-fcc6222aa967 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:08.617521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-447e7a81-1d28-41a2-83be-fcc6222aa967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:08.625911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:08.669102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb696d-e78d-4045-aba3-e3345661d9a0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:08.685255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb696d-e78d-4045-aba3-e3345661d9a0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:08.691125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1bebe-004e-45c9-8a7a-48bc5da9f6fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:08.691769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bebe-004e-45c9-8a7a-48bc5da9f6fb service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:08.692048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bebe-004e-45c9-8a7a-48bc5da9f6fb service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:08.692320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bebe-004e-45c9-8a7a-48bc5da9f6fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:08.701246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1bebe-004e-45c9-8a7a-48bc5da9f6fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:08.702879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1bebe-004e-45c9-8a7a-48bc5da9f6fb service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:08.712798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 695/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:09.663689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84826a-22b7-40f2-bc87-8fe15719243a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:09.664299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84826a-22b7-40f2-bc87-8fe15719243a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:09.664299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84826a-22b7-40f2-bc87-8fe15719243a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:09.665650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:09.670766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a127c-49c3-4082-9a14-ef214773e4bf None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:09.671257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a127c-49c3-4082-9a14-ef214773e4bf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:09.671361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a127c-49c3-4082-9a14-ef214773e4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:09.690732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7b5a127c-49c3-4082-9a14-ef214773e4bf None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:09.691956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7b5a127c-49c3-4082-9a14-ef214773e4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:09.701177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:09.851869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84826a-22b7-40f2-bc87-8fe15719243a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:09.867361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84826a-22b7-40f2-bc87-8fe15719243a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:09.873238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5b9b8-2ce0-4684-9ddf-154a079e19f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:09.873897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5b9b8-2ce0-4684-9ddf-154a079e19f2 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:09.874177 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5b9b8-2ce0-4684-9ddf-154a079e19f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:09.874457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5b9b8-2ce0-4684-9ddf-154a079e19f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:09.883189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5b9b8-2ce0-4684-9ddf-154a079e19f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:09.884772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5b9b8-2ce0-4684-9ddf-154a079e19f2 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:09.894683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 723/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:10.825748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12b864-ae40-4db2-8eee-fe7b10443967 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:10.826449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12b864-ae40-4db2-8eee-fe7b10443967 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:10.826449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12b864-ae40-4db2-8eee-fe7b10443967 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:10.827805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:06:10.833835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dedeaf-7fb4-4770-8e3f-878cd4e21b36 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:10.834321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dedeaf-7fb4-4770-8e3f-878cd4e21b36 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:10.834435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dedeaf-7fb4-4770-8e3f-878cd4e21b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:10.859694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-94dedeaf-7fb4-4770-8e3f-878cd4e21b36 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:10.861777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-94dedeaf-7fb4-4770-8e3f-878cd4e21b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:10.871065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:11.022425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12b864-ae40-4db2-8eee-fe7b10443967 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:11.038961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12b864-ae40-4db2-8eee-fe7b10443967 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:11.044937 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa8d44-7b14-4532-ba91-fe950b8d3c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:11.045614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa8d44-7b14-4532-ba91-fe950b8d3c0d service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:11.045889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa8d44-7b14-4532-ba91-fe950b8d3c0d service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:11.046161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa8d44-7b14-4532-ba91-fe950b8d3c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:11.054873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa8d44-7b14-4532-ba91-fe950b8d3c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:11.056471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa8d44-7b14-4532-ba91-fe950b8d3c0d service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:11.067394 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 698/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:12.005494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b16a98-627a-41d0-a335-0866d768905f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:12.006205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b16a98-627a-41d0-a335-0866d768905f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:12.006205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b16a98-627a-41d0-a335-0866d768905f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:12.007449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:12.012655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199586-646a-4b20-8f44-d1ce4a7cd84b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:12.013136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199586-646a-4b20-8f44-d1ce4a7cd84b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:12.013247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199586-646a-4b20-8f44-d1ce4a7cd84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:12.034277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dc199586-646a-4b20-8f44-d1ce4a7cd84b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:12.035502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dc199586-646a-4b20-8f44-d1ce4a7cd84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:12.043961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:12.196489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b16a98-627a-41d0-a335-0866d768905f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:12.213657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b16a98-627a-41d0-a335-0866d768905f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:12.219620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca91310-fd6d-49de-a515-d388d72760b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:12.220265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca91310-fd6d-49de-a515-d388d72760b6 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:12.220569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca91310-fd6d-49de-a515-d388d72760b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:12.220968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca91310-fd6d-49de-a515-d388d72760b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:12.229316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca91310-fd6d-49de-a515-d388d72760b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:12.231035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca91310-fd6d-49de-a515-d388d72760b6 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:12.240816 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 726/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:13.146227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798d96c-9591-4cfc-9069-f12f6be5f1a1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:13.146770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798d96c-9591-4cfc-9069-f12f6be5f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:13.146770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798d96c-9591-4cfc-9069-f12f6be5f1a1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:13.148089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:13.153434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f6e6c-2031-4b32-8e36-79ba78295381 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:13.153825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f6e6c-2031-4b32-8e36-79ba78295381 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:13.153990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f6e6c-2031-4b32-8e36-79ba78295381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:13.173192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3b1f6e6c-2031-4b32-8e36-79ba78295381 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:13.174565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3b1f6e6c-2031-4b32-8e36-79ba78295381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:13.183457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:13.337861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798d96c-9591-4cfc-9069-f12f6be5f1a1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:13.356663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798d96c-9591-4cfc-9069-f12f6be5f1a1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:13.364229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9954d7-1561-401f-b90f-8799f18f2346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:13.364885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9954d7-1561-401f-b90f-8799f18f2346 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:13.365169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9954d7-1561-401f-b90f-8799f18f2346 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:13.365481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9954d7-1561-401f-b90f-8799f18f2346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:13.374627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9954d7-1561-401f-b90f-8799f18f2346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:13.376238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9954d7-1561-401f-b90f-8799f18f2346 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:13.388358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 701/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:14.256981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2efc0-7fb1-4f8c-ab4b-ef56e0086041 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:14.257577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2efc0-7fb1-4f8c-ab4b-ef56e0086041 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:14.257577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2efc0-7fb1-4f8c-ab4b-ef56e0086041 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:14.258947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:14.265035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2af3-fe58-49cf-a98b-17b2773b2c32 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:14.265918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2af3-fe58-49cf-a98b-17b2773b2c32 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:14.266095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2af3-fe58-49cf-a98b-17b2773b2c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:14.290027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-df6c2af3-fe58-49cf-a98b-17b2773b2c32 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:14.291178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-df6c2af3-fe58-49cf-a98b-17b2773b2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:14.299607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:14.454108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2efc0-7fb1-4f8c-ab4b-ef56e0086041 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:14.472163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2efc0-7fb1-4f8c-ab4b-ef56e0086041 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:14.478589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344485-6a3a-4034-bb60-858e673f31da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:14.479247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344485-6a3a-4034-bb60-858e673f31da service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:14.479528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344485-6a3a-4034-bb60-858e673f31da service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:14.479793 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344485-6a3a-4034-bb60-858e673f31da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:14.489270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344485-6a3a-4034-bb60-858e673f31da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:14.490858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344485-6a3a-4034-bb60-858e673f31da service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:14.501193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 729/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:15.421732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777cd58-68bb-42ce-881e-c183a470caa2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:15.422433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777cd58-68bb-42ce-881e-c183a470caa2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:15.422433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777cd58-68bb-42ce-881e-c183a470caa2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:15.423993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:15.433079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af560b-9492-40c5-86bf-f9163aa2a7cd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:15.434074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af560b-9492-40c5-86bf-f9163aa2a7cd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:15.434074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af560b-9492-40c5-86bf-f9163aa2a7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:15.458514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-34af560b-9492-40c5-86bf-f9163aa2a7cd None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:15.459761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-34af560b-9492-40c5-86bf-f9163aa2a7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:15.468529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:15.637546 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777cd58-68bb-42ce-881e-c183a470caa2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:15.653018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777cd58-68bb-42ce-881e-c183a470caa2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:15.659994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe122683-a565-43bc-86f7-c845eeabc6e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:15.660631 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe122683-a565-43bc-86f7-c845eeabc6e5 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:15.660902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe122683-a565-43bc-86f7-c845eeabc6e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:15.661171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe122683-a565-43bc-86f7-c845eeabc6e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:15.671214 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe122683-a565-43bc-86f7-c845eeabc6e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:15.672879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe122683-a565-43bc-86f7-c845eeabc6e5 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:15.683721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 704/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:16.552011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327c96-b4c6-4c33-992f-13226c51c46e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:16.552605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327c96-b4c6-4c33-992f-13226c51c46e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:16.552605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327c96-b4c6-4c33-992f-13226c51c46e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:16.554027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:16.559775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dae42-a51d-48ac-8bbc-4995f9702a00 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:16.560551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dae42-a51d-48ac-8bbc-4995f9702a00 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:16.560551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dae42-a51d-48ac-8bbc-4995f9702a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:16.590203 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d01dae42-a51d-48ac-8bbc-4995f9702a00 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:16.593336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d01dae42-a51d-48ac-8bbc-4995f9702a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:16.601086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:16.754123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98327c96-b4c6-4c33-992f-13226c51c46e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:16.769307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98327c96-b4c6-4c33-992f-13226c51c46e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:16.775598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb22fd3-658a-412f-9c57-419d96532274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:16.776255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb22fd3-658a-412f-9c57-419d96532274 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:16.776535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb22fd3-658a-412f-9c57-419d96532274 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:16.776809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb22fd3-658a-412f-9c57-419d96532274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:16.786374 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb22fd3-658a-412f-9c57-419d96532274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:16.788013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb22fd3-658a-412f-9c57-419d96532274 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:16.799329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 732/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:17.702734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862ab70-4043-4cc6-b7f8-c53d2675d4fb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:17.703355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862ab70-4043-4cc6-b7f8-c53d2675d4fb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:17.703355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862ab70-4043-4cc6-b7f8-c53d2675d4fb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:17.704700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:17.710108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeda77-1a11-4f99-9a56-720b192d20e2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:17.710601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeda77-1a11-4f99-9a56-720b192d20e2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:17.710601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeda77-1a11-4f99-9a56-720b192d20e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:17.730938 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8bbeda77-1a11-4f99-9a56-720b192d20e2 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:17.732170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8bbeda77-1a11-4f99-9a56-720b192d20e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:17.743812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:17.894123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862ab70-4043-4cc6-b7f8-c53d2675d4fb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:17.913717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862ab70-4043-4cc6-b7f8-c53d2675d4fb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:17.920339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad04140-fe0c-4dd0-b9ba-47969e1cfd1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:17.921363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad04140-fe0c-4dd0-b9ba-47969e1cfd1f service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:17.921761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad04140-fe0c-4dd0-b9ba-47969e1cfd1f service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:17.922101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad04140-fe0c-4dd0-b9ba-47969e1cfd1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:17.932407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad04140-fe0c-4dd0-b9ba-47969e1cfd1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:17.934069 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad04140-fe0c-4dd0-b9ba-47969e1cfd1f service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:17.944279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 707/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:20.035859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0754c0-ec51-4698-b954-7cb337b6cd44 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:20.036426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0754c0-ec51-4698-b954-7cb337b6cd44 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:20.036426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0754c0-ec51-4698-b954-7cb337b6cd44 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:20.037811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:20.044485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a11f5-88ba-4a41-b9a4-5508cb6b87d4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:20.044972 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a11f5-88ba-4a41-b9a4-5508cb6b87d4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:20.045110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a11f5-88ba-4a41-b9a4-5508cb6b87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:20.071311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-366a11f5-88ba-4a41-b9a4-5508cb6b87d4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:20.072535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-366a11f5-88ba-4a41-b9a4-5508cb6b87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:20.081677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:20.119808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0754c0-ec51-4698-b954-7cb337b6cd44 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:20.131965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0754c0-ec51-4698-b954-7cb337b6cd44 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:20.135879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaa684-a34a-44ff-8493-a552f2098b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:20.136522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaa684-a34a-44ff-8493-a552f2098b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:20.136803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaa684-a34a-44ff-8493-a552f2098b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:20.137078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaa684-a34a-44ff-8493-a552f2098b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:20.146762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaa684-a34a-44ff-8493-a552f2098b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:20.148207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaa684-a34a-44ff-8493-a552f2098b24 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:20.158694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 735/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:22.489912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97512aa5-ae8e-444a-9737-26fe524729b4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:22.490828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97512aa5-ae8e-444a-9737-26fe524729b4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:22.490828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97512aa5-ae8e-444a-9737-26fe524729b4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:22.492770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:22.499028 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d3818-1ffc-40b9-b5ee-60a38a9b72a8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:22.499479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d3818-1ffc-40b9-b5ee-60a38a9b72a8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:22.499600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d3818-1ffc-40b9-b5ee-60a38a9b72a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:22.526124 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-df6d3818-1ffc-40b9-b5ee-60a38a9b72a8 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:22.527388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-df6d3818-1ffc-40b9-b5ee-60a38a9b72a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:22.536054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:22.583701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97512aa5-ae8e-444a-9737-26fe524729b4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:22.585843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-97512aa5-ae8e-444a-9737-26fe524729b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:22.601368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97512aa5-ae8e-444a-9737-26fe524729b4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:22.605675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cf484-2153-40f1-9295-eee256e25e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:22.606326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf484-2153-40f1-9295-eee256e25e40 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:22.606593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf484-2153-40f1-9295-eee256e25e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:22.606869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf484-2153-40f1-9295-eee256e25e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:22.617974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cf484-2153-40f1-9295-eee256e25e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:22.619441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cf484-2153-40f1-9295-eee256e25e40 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:22.634606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 710/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:25.327211 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d46dc-4282-4dfd-87f2-11d015461286 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:25.327835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d46dc-4282-4dfd-87f2-11d015461286 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:25.327835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d46dc-4282-4dfd-87f2-11d015461286 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:25.329134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:25.334822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f08be5-9851-4ed0-b92e-09c103ecff5e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:25.335310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f08be5-9851-4ed0-b92e-09c103ecff5e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:25.335411 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f08be5-9851-4ed0-b92e-09c103ecff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:25.355191 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-10f08be5-9851-4ed0-b92e-09c103ecff5e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:25.356453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-10f08be5-9851-4ed0-b92e-09c103ecff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:25.366607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:25.412836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d46dc-4282-4dfd-87f2-11d015461286 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:25.428353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d46dc-4282-4dfd-87f2-11d015461286 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:25.432887 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb4001-df89-4bd2-8840-83ee88b6fa71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:25.433581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb4001-df89-4bd2-8840-83ee88b6fa71 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:25.433857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb4001-df89-4bd2-8840-83ee88b6fa71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:25.434125 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb4001-df89-4bd2-8840-83ee88b6fa71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:25.445341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb4001-df89-4bd2-8840-83ee88b6fa71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:25.446790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb4001-df89-4bd2-8840-83ee88b6fa71 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:25.457983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 738/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:27.732196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9ab98-7e26-4ad3-9439-e89991d0db48 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:27.732790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9ab98-7e26-4ad3-9439-e89991d0db48 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:27.732790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9ab98-7e26-4ad3-9439-e89991d0db48 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:27.734291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:27.740769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f085c8-6597-47e7-a104-8f08e682e127 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:27.741250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f085c8-6597-47e7-a104-8f08e682e127 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:27.741391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f085c8-6597-47e7-a104-8f08e682e127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:27.759710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b4f085c8-6597-47e7-a104-8f08e682e127 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:27.760922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b4f085c8-6597-47e7-a104-8f08e682e127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:27.769936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:27.808339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9ab98-7e26-4ad3-9439-e89991d0db48 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:27.821500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9ab98-7e26-4ad3-9439-e89991d0db48 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:27.825852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15502684-aee8-4c6e-b2ff-a89c79f03b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:27.826508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15502684-aee8-4c6e-b2ff-a89c79f03b1e service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:27.826786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15502684-aee8-4c6e-b2ff-a89c79f03b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:27.827053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15502684-aee8-4c6e-b2ff-a89c79f03b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:27.836888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15502684-aee8-4c6e-b2ff-a89c79f03b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:27.838404 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15502684-aee8-4c6e-b2ff-a89c79f03b1e service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:27.848234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 713/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:30.042708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410922ca-22a0-49ba-afa5-da058e3bb877 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:30.043440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410922ca-22a0-49ba-afa5-da058e3bb877 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:30.043440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410922ca-22a0-49ba-afa5-da058e3bb877 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:30.045453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:30.053408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9787-7945-414c-8541-f45b5ea5788f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:30.053894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9787-7945-414c-8541-f45b5ea5788f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:30.054007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9787-7945-414c-8541-f45b5ea5788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:30.073994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-31cb9787-7945-414c-8541-f45b5ea5788f None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:30.075313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-31cb9787-7945-414c-8541-f45b5ea5788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:30.083472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:30.121504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410922ca-22a0-49ba-afa5-da058e3bb877 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:30.134564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410922ca-22a0-49ba-afa5-da058e3bb877 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:30.138903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b408d-ad27-4355-be32-3422423c7bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:30.139552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b408d-ad27-4355-be32-3422423c7bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:30.139836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b408d-ad27-4355-be32-3422423c7bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:30.140115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b408d-ad27-4355-be32-3422423c7bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:30.150350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b408d-ad27-4355-be32-3422423c7bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:30.151797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b408d-ad27-4355-be32-3422423c7bc2 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:30.161713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 741/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:32.457161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f67e38-d730-4024-b270-5c80eb659a1a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:32.457792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f67e38-d730-4024-b270-5c80eb659a1a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:32.457792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f67e38-d730-4024-b270-5c80eb659a1a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:32.459192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:32.464948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be8475-edd1-4210-a365-7ce5ef915b56 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:32.465439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be8475-edd1-4210-a365-7ce5ef915b56 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:32.465552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be8475-edd1-4210-a365-7ce5ef915b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:32.484582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-51be8475-edd1-4210-a365-7ce5ef915b56 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:32.485911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-51be8475-edd1-4210-a365-7ce5ef915b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:32.495054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:32.533394 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f67e38-d730-4024-b270-5c80eb659a1a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:32.545334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f67e38-d730-4024-b270-5c80eb659a1a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:32.549260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47fb71-dfec-4bbe-914d-337fc8e568fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:32.549931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47fb71-dfec-4bbe-914d-337fc8e568fb service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:32.550199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47fb71-dfec-4bbe-914d-337fc8e568fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:32.550517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47fb71-dfec-4bbe-914d-337fc8e568fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:32.559714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47fb71-dfec-4bbe-914d-337fc8e568fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:32.561147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47fb71-dfec-4bbe-914d-337fc8e568fb service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:32.570750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 716/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:34.756276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34ee4d-2f83-47bb-93fc-8d9bb335f426 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:34.756882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34ee4d-2f83-47bb-93fc-8d9bb335f426 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:34.756882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34ee4d-2f83-47bb-93fc-8d9bb335f426 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:34.758259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:34.763886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b94ec7-3648-44f9-bc96-0bca7cc438f4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:34.764423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b94ec7-3648-44f9-bc96-0bca7cc438f4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:34.764423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b94ec7-3648-44f9-bc96-0bca7cc438f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:34.771867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=70 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:06:34.785490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-62b94ec7-3648-44f9-bc96-0bca7cc438f4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:34.786711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-62b94ec7-3648-44f9-bc96-0bca7cc438f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:34.796109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:34.835167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34ee4d-2f83-47bb-93fc-8d9bb335f426 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:34.841014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=73 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:06:34.848267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34ee4d-2f83-47bb-93fc-8d9bb335f426 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:34.852022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85190316-96f0-488c-a192-3777d1d5c012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:34.852668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85190316-96f0-488c-a192-3777d1d5c012 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:34.852951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85190316-96f0-488c-a192-3777d1d5c012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:34.853257 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85190316-96f0-488c-a192-3777d1d5c012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:34.863177 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85190316-96f0-488c-a192-3777d1d5c012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:34.864624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85190316-96f0-488c-a192-3777d1d5c012 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:34.874632 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 744/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:37.027877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11a072-8ada-464d-a53e-c573f4d83877 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:37.028479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11a072-8ada-464d-a53e-c573f4d83877 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:37.028479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11a072-8ada-464d-a53e-c573f4d83877 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:37.029834 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:37.035474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71d46-0145-49fa-a3ee-ee1e41c23872 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:37.035912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71d46-0145-49fa-a3ee-ee1e41c23872 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:37.036048 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71d46-0145-49fa-a3ee-ee1e41c23872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:37.054515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-30d71d46-0145-49fa-a3ee-ee1e41c23872 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:37.055638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-30d71d46-0145-49fa-a3ee-ee1e41c23872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:37.064135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:37.101251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11a072-8ada-464d-a53e-c573f4d83877 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:37.112766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11a072-8ada-464d-a53e-c573f4d83877 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:37.116506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e37cf-04f2-49b7-967f-be86871b7b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:37.117143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e37cf-04f2-49b7-967f-be86871b7b02 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:37.117465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e37cf-04f2-49b7-967f-be86871b7b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:37.117738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e37cf-04f2-49b7-967f-be86871b7b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:37.127021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e37cf-04f2-49b7-967f-be86871b7b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:37.128500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e37cf-04f2-49b7-967f-be86871b7b02 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:37.138085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 719/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:39.276253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac8209-1459-495f-a37b-b4b14df85440 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:39.276858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac8209-1459-495f-a37b-b4b14df85440 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:39.276858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac8209-1459-495f-a37b-b4b14df85440 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:39.278260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:39.284018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e63732-4597-44af-a2f1-0edfe0692cb5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:39.284531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e63732-4597-44af-a2f1-0edfe0692cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:39.284531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e63732-4597-44af-a2f1-0edfe0692cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:39.303065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-06e63732-4597-44af-a2f1-0edfe0692cb5 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:39.304270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-06e63732-4597-44af-a2f1-0edfe0692cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:39.312720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:06:39.349323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac8209-1459-495f-a37b-b4b14df85440 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:39.361713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac8209-1459-495f-a37b-b4b14df85440 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:39.366146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60c522-0365-454b-9e28-f6aa52e1754b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:39.366787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c522-0365-454b-9e28-f6aa52e1754b service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:39.367064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c522-0365-454b-9e28-f6aa52e1754b service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:39.367333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c522-0365-454b-9e28-f6aa52e1754b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:39.376995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60c522-0365-454b-9e28-f6aa52e1754b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:39.378529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60c522-0365-454b-9e28-f6aa52e1754b service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:39.387964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 747/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:41.503598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e29c8e-9c5c-4e29-a684-e89ba1d9f70f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:41.504215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e29c8e-9c5c-4e29-a684-e89ba1d9f70f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:41.504215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e29c8e-9c5c-4e29-a684-e89ba1d9f70f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:41.505539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:06:41.511035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af840fa-b885-4b22-be17-ed0d05f153b3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:41.511482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af840fa-b885-4b22-be17-ed0d05f153b3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:41.511585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af840fa-b885-4b22-be17-ed0d05f153b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:41.530684 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4af840fa-b885-4b22-be17-ed0d05f153b3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:06:41.531879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4af840fa-b885-4b22-be17-ed0d05f153b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:06:41.540242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:06:41.577144 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e29c8e-9c5c-4e29-a684-e89ba1d9f70f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:06:41.589843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e29c8e-9c5c-4e29-a684-e89ba1d9f70f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:06:41.594053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9c86e-47d8-4cca-8fe3-8fe18757fdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:06:41.594693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9c86e-47d8-4cca-8fe3-8fe18757fdab service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:06:41.594972 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9c86e-47d8-4cca-8fe3-8fe18757fdab service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:06:41.595248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9c86e-47d8-4cca-8fe3-8fe18757fdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:06:41.605570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9c86e-47d8-4cca-8fe3-8fe18757fdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:06:41.607027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9c86e-47d8-4cca-8fe3-8fe18757fdab service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:06:41.617167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 722/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:06:51.525585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=17 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:06:51.612586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=17 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:07:01.618346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809baec-f1c1-4413-9ce8-988c33cbae2e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:01.618974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809baec-f1c1-4413-9ce8-988c33cbae2e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:01.618974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809baec-f1c1-4413-9ce8-988c33cbae2e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:01.620366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 749/1471] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:07:01.625788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a744-5c93-4e53-877f-2ceeb7bb5abe None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:01.626291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a744-5c93-4e53-877f-2ceeb7bb5abe None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:01.626291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a744-5c93-4e53-877f-2ceeb7bb5abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:01.646498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fba2a744-5c93-4e53-877f-2ceeb7bb5abe None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:07:01.646498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fba2a744-5c93-4e53-877f-2ceeb7bb5abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:07:01.654634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 723/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:07:01.703803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b61b24-ff19-4be6-8e26-eaaed24b3075 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:01.704092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b61b24-ff19-4be6-8e26-eaaed24b3075 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:01.704371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b61b24-ff19-4be6-8e26-eaaed24b3075 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:01.705912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 750/1473] 10.222.0.45 () {54 vars in 962 bytes} [Fri Jun 17 15:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:07:01.711533 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc75c6-0f90-4779-99ab-b8eb3ff5c017 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:01.711796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc75c6-0f90-4779-99ab-b8eb3ff5c017 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:01.712093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc75c6-0f90-4779-99ab-b8eb3ff5c017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:01.731464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-aacc75c6-0f90-4779-99ab-b8eb3ff5c017 None None] MFA Rules not processed for user `d8b74d07fba34715a488539d630b0bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:07:01.732675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aacc75c6-0f90-4779-99ab-b8eb3ff5c017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:07:01.740570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 724/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Jun 17 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:07:01.746977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b61b24-ff19-4be6-8e26-eaaed24b3075 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:07:01.758739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b61b24-ff19-4be6-8e26-eaaed24b3075 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:07:01.762705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546891de-0e00-4d57-9341-b2a8a7d59dde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b74d07fba34715a488539d630b0bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:07:01.767310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546891de-0e00-4d57-9341-b2a8a7d59dde service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:01.768077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546891de-0e00-4d57-9341-b2a8a7d59dde service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:01.768398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546891de-0e00-4d57-9341-b2a8a7d59dde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:01.778766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546891de-0e00-4d57-9341-b2a8a7d59dde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:07:01.780199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546891de-0e00-4d57-9341-b2a8a7d59dde service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:07:01.792122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 751/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:07:04.011259 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8a40-b03a-47d9-9a4a-d15366fba248 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:04.011886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8a40-b03a-47d9-9a4a-d15366fba248 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:04.011886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8a40-b03a-47d9-9a4a-d15366fba248 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:04.013469 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 725/1476] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:07:04.019062 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6783-dc6b-4b6f-8084-d10b2ee05a45 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:04.019559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6783-dc6b-4b6f-8084-d10b2ee05a45 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:04.019832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6783-dc6b-4b6f-8084-d10b2ee05a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:04.039730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d97f6783-dc6b-4b6f-8084-d10b2ee05a45 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:07:04.041019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d97f6783-dc6b-4b6f-8084-d10b2ee05a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:07:04.049942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 752/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:07:04.073651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe8a40-b03a-47d9-9a4a-d15366fba248 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:07:04.088075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe8a40-b03a-47d9-9a4a-d15366fba248 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:07:04.093153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44920638-9e14-4ddd-9e95-14806510ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:07:04.093929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44920638-9e14-4ddd-9e95-14806510ec21 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:04.094210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44920638-9e14-4ddd-9e95-14806510ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:04.094479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44920638-9e14-4ddd-9e95-14806510ec21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:04.095190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44920638-9e14-4ddd-9e95-14806510ec21 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:07:04.097171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-44920638-9e14-4ddd-9e95-14806510ec21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:07:04.097171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: warnings.warn(msg) Jun 17 15:07:04.097171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: Jun 17 15:07:04.098343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44920638-9e14-4ddd-9e95-14806510ec21 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:07:04.118644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 726/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 17 15:07:04 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:07:06.276677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e8cd-7bd0-43f5-bc97-65d5a4b45fa3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:06.277331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e8cd-7bd0-43f5-bc97-65d5a4b45fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:06.277331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e8cd-7bd0-43f5-bc97-65d5a4b45fa3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:06.278686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 753/1479] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:07:06.284335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878fd2d-6292-4980-a4b5-58a847daccdb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:06.285354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878fd2d-6292-4980-a4b5-58a847daccdb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:06.285647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878fd2d-6292-4980-a4b5-58a847daccdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:06.305020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4878fd2d-6292-4980-a4b5-58a847daccdb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:07:06.306288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4878fd2d-6292-4980-a4b5-58a847daccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:07:06.319024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 727/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:07:06.364615 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2e8cd-7bd0-43f5-bc97-65d5a4b45fa3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:07:06.382894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2e8cd-7bd0-43f5-bc97-65d5a4b45fa3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:07:06.389178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252bebf-1a7b-446e-b5ed-d7a341fa4d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:07:06.389868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252bebf-1a7b-446e-b5ed-d7a341fa4d78 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:06.390151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252bebf-1a7b-446e-b5ed-d7a341fa4d78 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:06.390428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252bebf-1a7b-446e-b5ed-d7a341fa4d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:06.399442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252bebf-1a7b-446e-b5ed-d7a341fa4d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:07:06.401027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252bebf-1a7b-446e-b5ed-d7a341fa4d78 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:07:06.410801 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 754/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:07:08.746340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3b51-7eee-455e-9062-ff37d15faeb7 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:08.746957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3b51-7eee-455e-9062-ff37d15faeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:08.746957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3b51-7eee-455e-9062-ff37d15faeb7 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:08.748285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 728/1482] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:07:08.754164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509601e1-8357-4990-baeb-7df44259e8b0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:08.754660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509601e1-8357-4990-baeb-7df44259e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:08.754772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509601e1-8357-4990-baeb-7df44259e8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:08.773365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-509601e1-8357-4990-baeb-7df44259e8b0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:07:08.774608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-509601e1-8357-4990-baeb-7df44259e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:07:08.782823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 755/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:07:08.820198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd3b51-7eee-455e-9062-ff37d15faeb7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:07:08.832950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd3b51-7eee-455e-9062-ff37d15faeb7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:07:08.836756 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba24c0-d4fb-4731-9b17-5045a36e133b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:07:08.837439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba24c0-d4fb-4731-9b17-5045a36e133b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:08.837723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba24c0-d4fb-4731-9b17-5045a36e133b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:08.838000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba24c0-d4fb-4731-9b17-5045a36e133b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:08.849103 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba24c0-d4fb-4731-9b17-5045a36e133b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:07:08.850620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba24c0-d4fb-4731-9b17-5045a36e133b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:07:08.861247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 729/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:07:11.032269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddbc80-3053-4f38-94db-e32ee84f6f24 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:11.033238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddbc80-3053-4f38-94db-e32ee84f6f24 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:11.033238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddbc80-3053-4f38-94db-e32ee84f6f24 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:11.035531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 756/1485] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:07:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:07:11.044796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5d97-d1d9-4c49-868a-2dfb1cc46ccb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:11.045583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5d97-d1d9-4c49-868a-2dfb1cc46ccb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:11.045583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5d97-d1d9-4c49-868a-2dfb1cc46ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:11.066628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9d1c5d97-d1d9-4c49-868a-2dfb1cc46ccb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:07:11.067818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9d1c5d97-d1d9-4c49-868a-2dfb1cc46ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:07:11.076595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 730/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:07:11.114934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddbc80-3053-4f38-94db-e32ee84f6f24 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:07:11.128325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddbc80-3053-4f38-94db-e32ee84f6f24 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:07:11.132790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ccf43-4232-4dd9-88d6-964efa7a5e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:07:11.133476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ccf43-4232-4dd9-88d6-964efa7a5e5d service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:11.133766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ccf43-4232-4dd9-88d6-964efa7a5e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:11.134039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ccf43-4232-4dd9-88d6-964efa7a5e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:11.144733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ccf43-4232-4dd9-88d6-964efa7a5e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:07:11.146220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ccf43-4232-4dd9-88d6-964efa7a5e5d service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:07:11.155998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 757/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:07:13.540399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d5431-39be-490a-8950-753134919d8d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:13.541322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d5431-39be-490a-8950-753134919d8d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:13.541322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d5431-39be-490a-8950-753134919d8d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:13.543714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 731/1488] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:07:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:07:13.549183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f95c-eaaf-44df-9f1a-9de48d748934 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:13.549644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f95c-eaaf-44df-9f1a-9de48d748934 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:13.549782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f95c-eaaf-44df-9f1a-9de48d748934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:13.570341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b8c0f95c-eaaf-44df-9f1a-9de48d748934 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:07:13.571564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b8c0f95c-eaaf-44df-9f1a-9de48d748934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:07:13.580481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 758/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:07:13.624524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d5431-39be-490a-8950-753134919d8d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:07:13.638537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d5431-39be-490a-8950-753134919d8d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:07:13.643135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521dce0-a2b2-4a31-bad6-2c1e7c830aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:07:13.643936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521dce0-a2b2-4a31-bad6-2c1e7c830aab service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:13.644210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521dce0-a2b2-4a31-bad6-2c1e7c830aab service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:13.644484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521dce0-a2b2-4a31-bad6-2c1e7c830aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:13.655005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521dce0-a2b2-4a31-bad6-2c1e7c830aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:07:13.656459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521dce0-a2b2-4a31-bad6-2c1e7c830aab service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:07:13.667583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 732/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:07:16.097165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e357c-cb7b-4bc6-bb52-bb58dec5aee1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:16.098341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e357c-cb7b-4bc6-bb52-bb58dec5aee1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:16.098341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e357c-cb7b-4bc6-bb52-bb58dec5aee1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:16.099290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 759/1491] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 17 15:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:07:16.104845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9073e6-ff9b-4225-8857-31e1ed26d9a9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:16.105333 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9073e6-ff9b-4225-8857-31e1ed26d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:16.105453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9073e6-ff9b-4225-8857-31e1ed26d9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:16.124553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ff9073e6-ff9b-4225-8857-31e1ed26d9a9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:07:16.125801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ff9073e6-ff9b-4225-8857-31e1ed26d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:07:16.134877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 733/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 17 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:07:16.176637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e357c-cb7b-4bc6-bb52-bb58dec5aee1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:07:16.189573 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e357c-cb7b-4bc6-bb52-bb58dec5aee1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:07:16.193775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28837642-e2e2-462a-a098-d114979eb7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:07:16.194427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837642-e2e2-462a-a098-d114979eb7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:07:16.194707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837642-e2e2-462a-a098-d114979eb7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:07:16.195023 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837642-e2e2-462a-a098-d114979eb7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:07:16.207002 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28837642-e2e2-462a-a098-d114979eb7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:07:16.208659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28837642-e2e2-462a-a098-d114979eb7f8 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:07:16.220365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 760/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:07:26.118929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=33 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:07:26.214943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=33 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:08:41.815108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db26c8-9406-40fa-91c0-a49dfca9a0b3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:41.815626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db26c8-9406-40fa-91c0-a49dfca9a0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:41.815626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db26c8-9406-40fa-91c0-a49dfca9a0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:41.836748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-34db26c8-9406-40fa-91c0-a49dfca9a0b3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:08:41.838006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-34db26c8-9406-40fa-91c0-a49dfca9a0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:08:41.846276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 734/1494] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:08:41.855854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccee7c-4a4f-4919-a94d-2699b9415452 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:41.856346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccee7c-4a4f-4919-a94d-2699b9415452 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:41.856346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccee7c-4a4f-4919-a94d-2699b9415452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:41.876466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-89ccee7c-4a4f-4919-a94d-2699b9415452 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:08:41.877689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-89ccee7c-4a4f-4919-a94d-2699b9415452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:08:41.886555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 761/1495] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:08:41.891195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db26c8-9406-40fa-91c0-a49dfca9a0b3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:08:41.901652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db26c8-9406-40fa-91c0-a49dfca9a0b3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:08:41.910242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13f3a4-91a0-4035-b381-588933617911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:08:41.911268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13f3a4-91a0-4035-b381-588933617911 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:41.911681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13f3a4-91a0-4035-b381-588933617911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:41.912081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13f3a4-91a0-4035-b381-588933617911 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:41.913297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13f3a4-91a0-4035-b381-588933617911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:08:41.913665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13f3a4-91a0-4035-b381-588933617911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:08:41.915215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-8b13f3a4-91a0-4035-b381-588933617911 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:08:41.915215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: warnings.warn(msg) Jun 17 15:08:41.915215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: Jun 17 15:08:41.916499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13f3a4-91a0-4035-b381-588933617911 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:08:41.932286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 735/1496] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:08:41.940741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccee7c-4a4f-4919-a94d-2699b9415452 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:08:41.950889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccee7c-4a4f-4919-a94d-2699b9415452 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:08:41.957341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992e469-4a9b-4bff-b36c-414b53a03f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:08:41.958012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992e469-4a9b-4bff-b36c-414b53a03f60 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:41.958287 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992e469-4a9b-4bff-b36c-414b53a03f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:41.958563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992e469-4a9b-4bff-b36c-414b53a03f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:41.959270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992e469-4a9b-4bff-b36c-414b53a03f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:08:41.961108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-c992e469-4a9b-4bff-b36c-414b53a03f60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:08:41.961108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: warnings.warn(msg) Jun 17 15:08:41.961108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: Jun 17 15:08:41.962352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992e469-4a9b-4bff-b36c-414b53a03f60 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:08:42.005872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 762/1497] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:08:41 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:08:42.010868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13f3a4-91a0-4035-b381-588933617911 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:08:42.021729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13f3a4-91a0-4035-b381-588933617911 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:08:42.085926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94795828-23c7-48f5-ae91-d7ca20c42378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:08:42.086602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94795828-23c7-48f5-ae91-d7ca20c42378 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.086883 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94795828-23c7-48f5-ae91-d7ca20c42378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.087156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94795828-23c7-48f5-ae91-d7ca20c42378 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.087843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94795828-23c7-48f5-ae91-d7ca20c42378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:08:42.088873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-94795828-23c7-48f5-ae91-d7ca20c42378 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:08:42.088873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: warnings.warn(msg) Jun 17 15:08:42.088873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: Jun 17 15:08:42.090240 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94795828-23c7-48f5-ae91-d7ca20c42378 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:08:42.111150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 736/1498] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:08:42 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:08:42.115916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992e469-4a9b-4bff-b36c-414b53a03f60 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:08:42.127143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992e469-4a9b-4bff-b36c-414b53a03f60 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:08:42.132505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d133-5786-4987-93d4-cb7e2593dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:08:42.133221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d133-5786-4987-93d4-cb7e2593dcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.133513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d133-5786-4987-93d4-cb7e2593dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.133787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d133-5786-4987-93d4-cb7e2593dcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.134518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d133-5786-4987-93d4-cb7e2593dcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:08:42.135537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-f5c2d133-5786-4987-93d4-cb7e2593dcf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:08:42.135537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: warnings.warn(msg) Jun 17 15:08:42.135537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: Jun 17 15:08:42.136414 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d133-5786-4987-93d4-cb7e2593dcf8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:08:42.150630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 763/1499] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:08:42.154951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94795828-23c7-48f5-ae91-d7ca20c42378 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:08:42.165892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94795828-23c7-48f5-ae91-d7ca20c42378 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:08:42.171787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d790b-cb10-493d-b0df-d4a9b812bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:08:42.172491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d790b-cb10-493d-b0df-d4a9b812bd2b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.172770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d790b-cb10-493d-b0df-d4a9b812bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.173041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d790b-cb10-493d-b0df-d4a9b812bd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.173813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d790b-cb10-493d-b0df-d4a9b812bd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:08:42.174853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-fa4d790b-cb10-493d-b0df-d4a9b812bd2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:08:42.174853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: warnings.warn(msg) Jun 17 15:08:42.174853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: Jun 17 15:08:42.175874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d790b-cb10-493d-b0df-d4a9b812bd2b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:08:42.190330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 737/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:08:42.194844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d133-5786-4987-93d4-cb7e2593dcf8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:08:42.206409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d133-5786-4987-93d4-cb7e2593dcf8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:08:42.212014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c60c9-c3da-4a81-a212-9f7027021f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:08:42.214932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c60c9-c3da-4a81-a212-9f7027021f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.214932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c60c9-c3da-4a81-a212-9f7027021f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.214932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c60c9-c3da-4a81-a212-9f7027021f6d admin admin] PATH_INFO: `/v3/projects/dea04f0c404c475f9c9b980570fb7e17/users/7ab6d20ce2144211a7927dc18cd96506/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.229764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c60c9-c3da-4a81-a212-9f7027021f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea04f0c404c475f9c9b980570fb7e17, user_id=7ab6d20ce2144211a7927dc18cd96506, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:08:42.230814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-5c6c60c9-c3da-4a81-a212-9f7027021f6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:08:42.230814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: warnings.warn(msg) Jun 17 15:08:42.230814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: Jun 17 15:08:42.232759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c60c9-c3da-4a81-a212-9f7027021f6d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:08:42.248243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 764/1501] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:08:42 2022] PUT /identity/v3/projects/dea04f0c404c475f9c9b980570fb7e17/users/7ab6d20ce2144211a7927dc18cd96506/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:08:42.260034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d55552-1c64-44b1-929b-311da400e4bb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.260258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d55552-1c64-44b1-929b-311da400e4bb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.260539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d55552-1c64-44b1-929b-311da400e4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.288340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-45d55552-1c64-44b1-929b-311da400e4bb None None] MFA Rules not processed for user `7ab6d20ce2144211a7927dc18cd96506`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:08:42.289566 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-45d55552-1c64-44b1-929b-311da400e4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:08:42.360724 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 738/1502] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:08:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:08:42.376351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce506-1501-4671-a47c-7533c77a4aaf None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.376642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce506-1501-4671-a47c-7533c77a4aaf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.376921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce506-1501-4671-a47c-7533c77a4aaf None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.378319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 765/1503] 10.222.0.45 () {54 vars in 963 bytes} [Fri Jun 17 15:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:08:42.383751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b920b-84da-4662-a9ab-c42d76812633 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.384036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b920b-84da-4662-a9ab-c42d76812633 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.384288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b920b-84da-4662-a9ab-c42d76812633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.403276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-790b920b-84da-4662-a9ab-c42d76812633 None None] MFA Rules not processed for user `b9cc8b94e9ba470ca1f620b7cbed8e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:08:42.404495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-790b920b-84da-4662-a9ab-c42d76812633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:08:42.450768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:08:42.460366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 739/1504] 10.222.0.45 () {58 vars in 1060 bytes} [Fri Jun 17 15:08:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:08:42.468671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fce506-1501-4671-a47c-7533c77a4aaf None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:08:42.481521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fce506-1501-4671-a47c-7533c77a4aaf None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:08:42.485602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fca21-609b-4adb-adce-99e2f4a23060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:08:42.486237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fca21-609b-4adb-adce-99e2f4a23060 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.486514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fca21-609b-4adb-adce-99e2f4a23060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.486786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fca21-609b-4adb-adce-99e2f4a23060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.495370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fca21-609b-4adb-adce-99e2f4a23060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:08:42.496813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fca21-609b-4adb-adce-99e2f4a23060 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:08:42.506410 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 766/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:08:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:08:42.551641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedcec6-a86d-45a4-acec-634baef65872 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.551999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedcec6-a86d-45a4-acec-634baef65872 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.552279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedcec6-a86d-45a4-acec-634baef65872 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.553585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 740/1506] 10.222.0.45 () {52 vars in 829 bytes} [Fri Jun 17 15:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:08:42.557504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fca21-609b-4adb-adce-99e2f4a23060 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:08:42.625803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fca21-609b-4adb-adce-99e2f4a23060 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:08:42.631618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:08:42.632552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.632831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.633102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] PATH_INFO: `/v3/users/7ab6d20ce2144211a7927dc18cd96506` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.634880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab6d20ce2144211a7927dc18cd96506)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:08:42.636392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:08:42.636392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: warnings.warn(msg) Jun 17 15:08:42.636392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: Jun 17 15:08:42.638252 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:08:42.714311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab6d20ce2144211a7927dc18cd96506'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:08:42.727864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab6d20ce2144211a7927dc18cd96506'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:08:42.728731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab6d20ce2144211a7927dc18cd96506'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:08:42.741466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab6d20ce2144211a7927dc18cd96506'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:08:42.742165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab6d20ce2144211a7927dc18cd96506'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:08:42.758570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:08:42.770964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 767/1507] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:08:42 2022] DELETE /identity/v3/users/7ab6d20ce2144211a7927dc18cd96506 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:08:42.772639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b136f-ca09-4179-b989-c4ea77a98654 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.772928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b136f-ca09-4179-b989-c4ea77a98654 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.773239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b136f-ca09-4179-b989-c4ea77a98654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.791683 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-120b136f-ca09-4179-b989-c4ea77a98654 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:08:42.792894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-120b136f-ca09-4179-b989-c4ea77a98654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:08:42.858776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 741/1508] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:08:42.869390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:08:42.870885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:08:42.931185 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee198dd-029d-42b8-84c4-a3236c8cd012 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:08:42.935388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1b06a-e84c-46df-acee-6e51ada3e726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:08:42.936038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b06a-e84c-46df-acee-6e51ada3e726 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:42.936379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b06a-e84c-46df-acee-6e51ada3e726 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:42.936755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b06a-e84c-46df-acee-6e51ada3e726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:42.946438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1b06a-e84c-46df-acee-6e51ada3e726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:08:42.947871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1b06a-e84c-46df-acee-6e51ada3e726 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:08:42.958472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 768/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:08:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:08:43.371102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b136f-ca09-4179-b989-c4ea77a98654 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:08:43.372538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-120b136f-ca09-4179-b989-c4ea77a98654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:08:43.384847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b136f-ca09-4179-b989-c4ea77a98654 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:08:43.392298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:08:43.392298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:08:43.392298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:08:43.392298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] PATH_INFO: `/v3/projects/dea04f0c404c475f9c9b980570fb7e17` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:08:43.393154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea04f0c404c475f9c9b980570fb7e17)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:08:43.394227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:08:43.394227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: warnings.warn(msg) Jun 17 15:08:43.394227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: Jun 17 15:08:43.395770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:08:43.457944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea04f0c404c475f9c9b980570fb7e17', 'request_id': 'req-407a9db0-c05a-4e70-bf9e-30a4228da1ff'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:08:43.471129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea04f0c404c475f9c9b980570fb7e17', 'request_id': 'req-407a9db0-c05a-4e70-bf9e-30a4228da1ff'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:08:43.482367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea04f0c404c475f9c9b980570fb7e17', 'request_id': 'req-407a9db0-c05a-4e70-bf9e-30a4228da1ff'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:08:43.494345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] The token cache is being invalidate because project dea04f0c404c475f9c9b980570fb7e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:08:43.494631 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:08:43.495298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-407a9db0-c05a-4e70-bf9e-30a4228da1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:08:43.496971 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 742/1510] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:08:43 2022] DELETE /identity/v3/projects/dea04f0c404c475f9c9b980570fb7e17 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:08:52.953680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:08:53.491332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:10:29.332330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d9a1-5754-4154-91da-3dca4c2f346c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:29.332977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d9a1-5754-4154-91da-3dca4c2f346c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:29.332977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d9a1-5754-4154-91da-3dca4c2f346c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:29.334943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:10:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:10:29.339996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5959e9-17a0-4a41-8a70-d36b279cf665 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:29.340450 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5959e9-17a0-4a41-8a70-d36b279cf665 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:29.340552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5959e9-17a0-4a41-8a70-d36b279cf665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:29.360898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5a5959e9-17a0-4a41-8a70-d36b279cf665 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:10:29.362130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5a5959e9-17a0-4a41-8a70-d36b279cf665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:29.426571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:10:29.597413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d9a1-5754-4154-91da-3dca4c2f346c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:10:29.600786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ecc4d9a1-5754-4154-91da-3dca4c2f346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:29.691450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d9a1-5754-4154-91da-3dca4c2f346c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:10:29.697788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39708d2-985c-44cd-b17e-e8da71d3d555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:10:29.698440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39708d2-985c-44cd-b17e-e8da71d3d555 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:29.698729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39708d2-985c-44cd-b17e-e8da71d3d555 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:29.699004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39708d2-985c-44cd-b17e-e8da71d3d555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:29.708083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39708d2-985c-44cd-b17e-e8da71d3d555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:10:29.709721 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39708d2-985c-44cd-b17e-e8da71d3d555 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:10:29.719156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 770/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:10:30.617950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057c76-ff23-4174-bcb8-ec061ca46486 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:30.618593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057c76-ff23-4174-bcb8-ec061ca46486 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:30.618593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057c76-ff23-4174-bcb8-ec061ca46486 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:30.620496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:10:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:10:30.627761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f4d92-8434-4f53-a7ac-6aabd095e8aa None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:30.628193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f4d92-8434-4f53-a7ac-6aabd095e8aa None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:30.628348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f4d92-8434-4f53-a7ac-6aabd095e8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:30.649044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-871f4d92-8434-4f53-a7ac-6aabd095e8aa None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:10:30.650283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-871f4d92-8434-4f53-a7ac-6aabd095e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:30.660307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:10:30.814975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680787bf-9148-40a0-a5f7-08616dbc1f71 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:30.815210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f4d92-8434-4f53-a7ac-6aabd095e8aa None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:10:30.815315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680787bf-9148-40a0-a5f7-08616dbc1f71 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:30.815518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680787bf-9148-40a0-a5f7-08616dbc1f71 None None] PATH_INFO: `/v3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:30.816838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 745/1516] 10.222.0.25 () {54 vars in 925 bytes} [Fri Jun 17 15:10:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:10:30.823619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab25a-7ab6-421c-ba09-616f1e593551 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:30.823900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab25a-7ab6-421c-ba09-616f1e593551 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:30.824165 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab25a-7ab6-421c-ba09-616f1e593551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:30.828320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f4d92-8434-4f53-a7ac-6aabd095e8aa None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:10:30.836051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838cd72-3f7d-470b-852d-936a62129272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:10:30.836698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838cd72-3f7d-470b-852d-936a62129272 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:30.836978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838cd72-3f7d-470b-852d-936a62129272 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:30.837734 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838cd72-3f7d-470b-852d-936a62129272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:30.842824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dacab25a-7ab6-421c-ba09-616f1e593551 None None] MFA Rules not processed for user `328d0413dc65420c841b452f45c5b0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:10:30.844015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dacab25a-7ab6-421c-ba09-616f1e593551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:30.846984 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838cd72-3f7d-470b-852d-936a62129272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:10:30.848575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838cd72-3f7d-470b-852d-936a62129272 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:10:30.858488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 772/1517] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:10:30.909315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 746/1518] 10.222.0.25 () {58 vars in 1015 bytes} [Fri Jun 17 15:10:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:10:39.679445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef54402-0d7e-43c5-9798-fe17ef8874f1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:39.679445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef54402-0d7e-43c5-9798-fe17ef8874f1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:39.680252 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef54402-0d7e-43c5-9798-fe17ef8874f1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:39.681633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 773/1519] 10.222.0.45 () {54 vars in 960 bytes} [Fri Jun 17 15:10:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:10:39.689257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09b628-f72e-43bb-85f8-a0d2ee562eaa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:39.689727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09b628-f72e-43bb-85f8-a0d2ee562eaa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:39.689831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09b628-f72e-43bb-85f8-a0d2ee562eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:39.710885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6e09b628-f72e-43bb-85f8-a0d2ee562eaa None None] MFA Rules not processed for user `328d0413dc65420c841b452f45c5b0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:10:39.712080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6e09b628-f72e-43bb-85f8-a0d2ee562eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:39.721488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 747/1520] 10.222.0.45 () {58 vars in 1057 bytes} [Fri Jun 17 15:10:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:10:39.731273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef54402-0d7e-43c5-9798-fe17ef8874f1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:10:39.746941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef54402-0d7e-43c5-9798-fe17ef8874f1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:10:39.752391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5342d36-3b2c-4963-8864-aaa80280861b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:10:39.753006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5342d36-3b2c-4963-8864-aaa80280861b service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:39.753322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5342d36-3b2c-4963-8864-aaa80280861b service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:39.753602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5342d36-3b2c-4963-8864-aaa80280861b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:39.762972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5342d36-3b2c-4963-8864-aaa80280861b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:10:39.764554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5342d36-3b2c-4963-8864-aaa80280861b service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:10:39.775048 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 774/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:10:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:10:42.174851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711d86-b2ab-47e8-b42f-476730b9b4e4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:42.175412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711d86-b2ab-47e8-b42f-476730b9b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:42.175412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711d86-b2ab-47e8-b42f-476730b9b4e4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:42.177274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 748/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:10:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:10:42.182872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05afcb-a77c-4c30-8ca6-ff283b6e1cb3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:42.183346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05afcb-a77c-4c30-8ca6-ff283b6e1cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:42.183462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05afcb-a77c-4c30-8ca6-ff283b6e1cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:42.204076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5b05afcb-a77c-4c30-8ca6-ff283b6e1cb3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:10:42.205314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5b05afcb-a77c-4c30-8ca6-ff283b6e1cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:42.215972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 775/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:10:42.373550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47711d86-b2ab-47e8-b42f-476730b9b4e4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:10:42.395830 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47711d86-b2ab-47e8-b42f-476730b9b4e4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:10:42.404200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203366a4-838f-409a-95d9-28f55761120f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:10:42.404885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203366a4-838f-409a-95d9-28f55761120f service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:42.405167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203366a4-838f-409a-95d9-28f55761120f service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:42.405553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203366a4-838f-409a-95d9-28f55761120f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:42.419731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203366a4-838f-409a-95d9-28f55761120f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:10:42.422126 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203366a4-838f-409a-95d9-28f55761120f service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:10:42.435076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 749/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:10:43.304116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428f641-6354-4672-b43a-8b05903dfc81 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:43.305169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428f641-6354-4672-b43a-8b05903dfc81 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:43.305169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428f641-6354-4672-b43a-8b05903dfc81 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:43.307409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 776/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 15:10:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:10:43.313438 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f631a8-7e5b-4b03-b1ca-3a2377c978d7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:43.314152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f631a8-7e5b-4b03-b1ca-3a2377c978d7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:43.314329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f631a8-7e5b-4b03-b1ca-3a2377c978d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:43.336836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e4f631a8-7e5b-4b03-b1ca-3a2377c978d7 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:10:43.338080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e4f631a8-7e5b-4b03-b1ca-3a2377c978d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:43.349144 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 750/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 15:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:10:43.510973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428f641-6354-4672-b43a-8b05903dfc81 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:10:43.536030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428f641-6354-4672-b43a-8b05903dfc81 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:10:43.543713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f3428-9d83-46a8-96f2-616898315f91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:10:43.544353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3428-9d83-46a8-96f2-616898315f91 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:43.544631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3428-9d83-46a8-96f2-616898315f91 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:43.544902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3428-9d83-46a8-96f2-616898315f91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:43.553325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f3428-9d83-46a8-96f2-616898315f91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:10:43.555123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f3428-9d83-46a8-96f2-616898315f91 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:10:43.564964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 777/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:10:47.685491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362d092-99e4-4d32-ae0f-82b6c905b437 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:47.686361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362d092-99e4-4d32-ae0f-82b6c905b437 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:47.686361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362d092-99e4-4d32-ae0f-82b6c905b437 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:47.688545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:10:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:10:47.694120 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422fcf-d0c5-42f6-bdf9-edc39e15b781 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:47.694567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422fcf-d0c5-42f6-bdf9-edc39e15b781 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:47.694663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422fcf-d0c5-42f6-bdf9-edc39e15b781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:47.717746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ca422fcf-d0c5-42f6-bdf9-edc39e15b781 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:10:47.718995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ca422fcf-d0c5-42f6-bdf9-edc39e15b781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:47.727486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:10:47.769551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362d092-99e4-4d32-ae0f-82b6c905b437 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:10:47.772980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d362d092-99e4-4d32-ae0f-82b6c905b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:47.835192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362d092-99e4-4d32-ae0f-82b6c905b437 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:10:47.839042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150ed40-085d-44de-8d2d-bf94a23976b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:10:47.839675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150ed40-085d-44de-8d2d-bf94a23976b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:47.839953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150ed40-085d-44de-8d2d-bf94a23976b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:47.840229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150ed40-085d-44de-8d2d-bf94a23976b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:47.849652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150ed40-085d-44de-8d2d-bf94a23976b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:10:47.851182 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150ed40-085d-44de-8d2d-bf94a23976b8 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:10:47.860804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 752/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:10:49.982072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb210ab6-ceb9-4df2-875e-94c37c04d5e9 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:49.982599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb210ab6-ceb9-4df2-875e-94c37c04d5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:49.982695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb210ab6-ceb9-4df2-875e-94c37c04d5e9 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:49.984054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:10:49.989373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0ea0a-2db2-488c-a74d-1eceda92e1be None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:49.989850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0ea0a-2db2-488c-a74d-1eceda92e1be None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:49.989951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0ea0a-2db2-488c-a74d-1eceda92e1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:50.008676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4fb0ea0a-2db2-488c-a74d-1eceda92e1be None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:10:50.009962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4fb0ea0a-2db2-488c-a74d-1eceda92e1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:50.020557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:10:50.068643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb210ab6-ceb9-4df2-875e-94c37c04d5e9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:10:50.086339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb210ab6-ceb9-4df2-875e-94c37c04d5e9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:10:50.091063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f10f8-dba5-47e0-a8f5-c0f44a8b516b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:10:50.091715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f10f8-dba5-47e0-a8f5-c0f44a8b516b service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:50.091995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f10f8-dba5-47e0-a8f5-c0f44a8b516b service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:50.092250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f10f8-dba5-47e0-a8f5-c0f44a8b516b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:50.102708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f10f8-dba5-47e0-a8f5-c0f44a8b516b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:10:50.104138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f10f8-dba5-47e0-a8f5-c0f44a8b516b service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:10:50.113755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 780/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:10:53.902388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08be249-ac12-4a38-92f9-e8683a05599d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:53.903339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08be249-ac12-4a38-92f9-e8683a05599d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:53.903339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08be249-ac12-4a38-92f9-e8683a05599d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:53.905734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 754/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:10:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:10:53.914140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57745108-9c36-407f-a076-97d98a24f99b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:53.914605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57745108-9c36-407f-a076-97d98a24f99b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:53.914714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57745108-9c36-407f-a076-97d98a24f99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:53.925744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=68 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:10:53.941536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-57745108-9c36-407f-a076-97d98a24f99b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:10:53.942741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-57745108-9c36-407f-a076-97d98a24f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:53.952218 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 781/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:10:54.218407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08be249-ac12-4a38-92f9-e8683a05599d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:10:54.221849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d08be249-ac12-4a38-92f9-e8683a05599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:54.230665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:10:54.284782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08be249-ac12-4a38-92f9-e8683a05599d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:10:54.288834 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf3539-cbd1-4b5a-9147-b7abb16a01d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:10:54.289570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3539-cbd1-4b5a-9147-b7abb16a01d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:54.289951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3539-cbd1-4b5a-9147-b7abb16a01d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:54.290238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3539-cbd1-4b5a-9147-b7abb16a01d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:54.302395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf3539-cbd1-4b5a-9147-b7abb16a01d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:10:54.303882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf3539-cbd1-4b5a-9147-b7abb16a01d1 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:10:54.313743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 755/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:10:56.445080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea7a4-3b6a-40cc-ab02-34ece9c005c4 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:56.445870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea7a4-3b6a-40cc-ab02-34ece9c005c4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:56.445870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea7a4-3b6a-40cc-ab02-34ece9c005c4 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:56.447540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 782/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 15:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:10:56.454247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43014a7e-f45b-4e99-800b-fab4e58283c6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:56.454853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43014a7e-f45b-4e99-800b-fab4e58283c6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:56.454853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43014a7e-f45b-4e99-800b-fab4e58283c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:56.474619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-43014a7e-f45b-4e99-800b-fab4e58283c6 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:10:56.475808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-43014a7e-f45b-4e99-800b-fab4e58283c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:56.486682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 756/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 15:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:10:56.745523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea7a4-3b6a-40cc-ab02-34ece9c005c4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:10:56.747605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-085ea7a4-3b6a-40cc-ab02-34ece9c005c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:10:56.764158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea7a4-3b6a-40cc-ab02-34ece9c005c4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:10:56.768626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f6e0b-9f5b-43a7-b525-74c7d9057e64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:10:56.769369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f6e0b-9f5b-43a7-b525-74c7d9057e64 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:10:56.769724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f6e0b-9f5b-43a7-b525-74c7d9057e64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:10:56.769914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f6e0b-9f5b-43a7-b525-74c7d9057e64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:10:56.782034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f6e0b-9f5b-43a7-b525-74c7d9057e64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:10:56.783462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f6e0b-9f5b-43a7-b525-74c7d9057e64 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:10:56.794878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 783/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:11:06.469092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=28 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:06.790067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=8 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:26.670743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ae008-8418-4f71-a85a-2bc76492ba6a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:26.672039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ae008-8418-4f71-a85a-2bc76492ba6a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:26.672565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ae008-8418-4f71-a85a-2bc76492ba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:26.702531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-419ae008-8418-4f71-a85a-2bc76492ba6a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:26.704024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-419ae008-8418-4f71-a85a-2bc76492ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:26.716817 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 757/1540] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:26.726663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31577db-dea7-478b-8929-116604a2237a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:26.727300 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31577db-dea7-478b-8929-116604a2237a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:26.727300 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31577db-dea7-478b-8929-116604a2237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:26.730685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4831b6d-ab27-4e4c-ad03-e198b6db88f9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:26.731038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4831b6d-ab27-4e4c-ad03-e198b6db88f9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:26.731247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4831b6d-ab27-4e4c-ad03-e198b6db88f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:26.755459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f4831b6d-ab27-4e4c-ad03-e198b6db88f9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:26.756700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f4831b6d-ab27-4e4c-ad03-e198b6db88f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:26.768619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 758/1541] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:12:26.768964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b31577db-dea7-478b-8929-116604a2237a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:26.770219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b31577db-dea7-478b-8929-116604a2237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:26.778366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4831b6d-ab27-4e4c-ad03-e198b6db88f9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:26.787552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 784/1542] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:12:26.798572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529b9e-a7b6-4f9e-a3dc-da41f98919e4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:26.798572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529b9e-a7b6-4f9e-a3dc-da41f98919e4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:26.799025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529b9e-a7b6-4f9e-a3dc-da41f98919e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:26.804109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4831b6d-ab27-4e4c-ad03-e198b6db88f9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:26.808987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0b87-a1db-4ed4-b4d0-4fe4a2c0c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:26.810437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0b87-a1db-4ed4-b4d0-4fe4a2c0c6fc admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:26.810723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0b87-a1db-4ed4-b4d0-4fe4a2c0c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:26.811000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0b87-a1db-4ed4-b4d0-4fe4a2c0c6fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:26.811735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc0b87-a1db-4ed4-b4d0-4fe4a2c0c6fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:26.812046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc0b87-a1db-4ed4-b4d0-4fe4a2c0c6fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:26.813744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc0b87-a1db-4ed4-b4d0-4fe4a2c0c6fc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:26.831764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 759/1543] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:12:26.833411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-91529b9e-a7b6-4f9e-a3dc-da41f98919e4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:26.834831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-91529b9e-a7b6-4f9e-a3dc-da41f98919e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:26.842701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0b87-a1db-4ed4-b4d0-4fe4a2c0c6fc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:26.864486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0b87-a1db-4ed4-b4d0-4fe4a2c0c6fc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:26.866079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 785/1544] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:12:26.870823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91529b9e-a7b6-4f9e-a3dc-da41f98919e4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:26.876299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9be8c8-ae75-4002-8717-8f19539e6f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:26.877037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be8c8-ae75-4002-8717-8f19539e6f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:26.877338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be8c8-ae75-4002-8717-8f19539e6f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:26.877615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be8c8-ae75-4002-8717-8f19539e6f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:26.878308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9be8c8-ae75-4002-8717-8f19539e6f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:26.879359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-df9be8c8-ae75-4002-8717-8f19539e6f82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:12:26.879359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: warnings.warn(msg) Jun 17 15:12:26.879359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: Jun 17 15:12:26.880558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9be8c8-ae75-4002-8717-8f19539e6f82 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:26.892851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91529b9e-a7b6-4f9e-a3dc-da41f98919e4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:26.901373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110a3f9-8ecf-4a16-8b18-be6c03a27c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:26.902196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110a3f9-8ecf-4a16-8b18-be6c03a27c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:26.902475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110a3f9-8ecf-4a16-8b18-be6c03a27c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:26.902744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110a3f9-8ecf-4a16-8b18-be6c03a27c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:26.903884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110a3f9-8ecf-4a16-8b18-be6c03a27c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:26.904193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110a3f9-8ecf-4a16-8b18-be6c03a27c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:26.905441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-c110a3f9-8ecf-4a16-8b18-be6c03a27c1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:12:26.905441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: warnings.warn(msg) Jun 17 15:12:26.905441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: Jun 17 15:12:26.906347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110a3f9-8ecf-4a16-8b18-be6c03a27c1d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:26.928771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 786/1545] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:12:26.930311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1900b-c985-4f59-b46f-b2f31162b755 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:26.930600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1900b-c985-4f59-b46f-b2f31162b755 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:26.930881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1900b-c985-4f59-b46f-b2f31162b755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:26.937423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 760/1546] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:26 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:26.938944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4e73d-8ae8-4df4-a16f-da89b08932a4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:26.939280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4e73d-8ae8-4df4-a16f-da89b08932a4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:26.939569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4e73d-8ae8-4df4-a16f-da89b08932a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:26.964692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-93b1900b-c985-4f59-b46f-b2f31162b755 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:26.966231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-93b1900b-c985-4f59-b46f-b2f31162b755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:26.978158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c3e4e73d-8ae8-4df4-a16f-da89b08932a4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:26.979406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c3e4e73d-8ae8-4df4-a16f-da89b08932a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.056665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 761/1547] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.057430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4e73d-8ae8-4df4-a16f-da89b08932a4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.065173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 787/1548] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.065173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1900b-c985-4f59-b46f-b2f31162b755 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.068145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4e73d-8ae8-4df4-a16f-da89b08932a4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.073258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202637-223f-4d6b-8b51-05188a9723f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.074039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202637-223f-4d6b-8b51-05188a9723f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.074319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202637-223f-4d6b-8b51-05188a9723f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.074596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202637-223f-4d6b-8b51-05188a9723f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.075287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202637-223f-4d6b-8b51-05188a9723f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.077070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1900b-c985-4f59-b46f-b2f31162b755 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.077360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202637-223f-4d6b-8b51-05188a9723f4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.083044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c393d47-65e4-4a12-ae45-7e2fc63d30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.083732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393d47-65e4-4a12-ae45-7e2fc63d30e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.084015 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393d47-65e4-4a12-ae45-7e2fc63d30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.084288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393d47-65e4-4a12-ae45-7e2fc63d30e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.084986 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c393d47-65e4-4a12-ae45-7e2fc63d30e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.086046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-2c393d47-65e4-4a12-ae45-7e2fc63d30e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:12:27.086046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: warnings.warn(msg) Jun 17 15:12:27.086046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: Jun 17 15:12:27.087290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c393d47-65e4-4a12-ae45-7e2fc63d30e4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.113945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 788/1549] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:27.113945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178c5d-213e-4c4a-944e-e03098213e2c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.113945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178c5d-213e-4c4a-944e-e03098213e2c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.113945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178c5d-213e-4c4a-944e-e03098213e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.117009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 762/1550] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:27.118400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93c6c6-7fa7-46b4-b6af-751c22617fb0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.118690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93c6c6-7fa7-46b4-b6af-751c22617fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.118970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93c6c6-7fa7-46b4-b6af-751c22617fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.134729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6e178c5d-213e-4c4a-944e-e03098213e2c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.135888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4b93c6c6-7fa7-46b4-b6af-751c22617fb0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.136016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6e178c5d-213e-4c4a-944e-e03098213e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.137049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b93c6c6-7fa7-46b4-b6af-751c22617fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.197976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 789/1551] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.198210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 763/1552] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.206918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687ae65-6a6f-4ee1-8b8e-592eb90e5348 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.206918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687ae65-6a6f-4ee1-8b8e-592eb90e5348 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.206918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687ae65-6a6f-4ee1-8b8e-592eb90e5348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.207339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e9bc7-4988-47c4-a68a-f56b3d1f84f9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.207339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e9bc7-4988-47c4-a68a-f56b3d1f84f9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.207519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e9bc7-4988-47c4-a68a-f56b3d1f84f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.225014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2687ae65-6a6f-4ee1-8b8e-592eb90e5348 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.226205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2687ae65-6a6f-4ee1-8b8e-592eb90e5348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.226873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e54e9bc7-4988-47c4-a68a-f56b3d1f84f9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.228027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e54e9bc7-4988-47c4-a68a-f56b3d1f84f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.234828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 790/1553] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.236314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556ee38-7b83-4807-ac72-d0c6199e78a8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.236628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556ee38-7b83-4807-ac72-d0c6199e78a8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.236890 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556ee38-7b83-4807-ac72-d0c6199e78a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.245261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 764/1554] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.246529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01518d-23fc-413c-9f7c-eb02e72b73c1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.246874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01518d-23fc-413c-9f7c-eb02e72b73c1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.247207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01518d-23fc-413c-9f7c-eb02e72b73c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.256506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a556ee38-7b83-4807-ac72-d0c6199e78a8 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.257836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a556ee38-7b83-4807-ac72-d0c6199e78a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.266522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4c01518d-23fc-413c-9f7c-eb02e72b73c1 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.266682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 791/1555] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.267428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556ee38-7b83-4807-ac72-d0c6199e78a8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.268041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c01518d-23fc-413c-9f7c-eb02e72b73c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.276744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 765/1556] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.277594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01518d-23fc-413c-9f7c-eb02e72b73c1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.277732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556ee38-7b83-4807-ac72-d0c6199e78a8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.288022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01236e68-58a9-4583-b2ae-3e7dffdfc3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.288703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01236e68-58a9-4583-b2ae-3e7dffdfc3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.288982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01236e68-58a9-4583-b2ae-3e7dffdfc3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.289427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01236e68-58a9-4583-b2ae-3e7dffdfc3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.290339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01236e68-58a9-4583-b2ae-3e7dffdfc3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.291944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01236e68-58a9-4583-b2ae-3e7dffdfc3b8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.293654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01518d-23fc-413c-9f7c-eb02e72b73c1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.298872 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd156c-5102-4c65-8772-a2e680f97358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.299756 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd156c-5102-4c65-8772-a2e680f97358 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.300115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd156c-5102-4c65-8772-a2e680f97358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.300393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd156c-5102-4c65-8772-a2e680f97358 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.301314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd156c-5102-4c65-8772-a2e680f97358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.302554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 792/1557] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:27.306053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd156c-5102-4c65-8772-a2e680f97358 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.306164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af4160-21c8-4364-93be-39f860d5cd7b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.306164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af4160-21c8-4364-93be-39f860d5cd7b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.306164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af4160-21c8-4364-93be-39f860d5cd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.320659 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:27.322936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-87af4160-21c8-4364-93be-39f860d5cd7b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.324197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-87af4160-21c8-4364-93be-39f860d5cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.329401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 766/1558] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:27.331105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c22d0-513b-4d64-b448-0d2768ef3aa2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.331679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c22d0-513b-4d64-b448-0d2768ef3aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.332229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c22d0-513b-4d64-b448-0d2768ef3aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.336538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 793/1559] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.337865 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f7a8-4dc7-48d8-bd23-33d4824698bd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.338156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f7a8-4dc7-48d8-bd23-33d4824698bd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.338435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f7a8-4dc7-48d8-bd23-33d4824698bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.352429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-580c22d0-513b-4d64-b448-0d2768ef3aa2 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.353682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-580c22d0-513b-4d64-b448-0d2768ef3aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.356390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1d84f7a8-4dc7-48d8-bd23-33d4824698bd None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.357599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1d84f7a8-4dc7-48d8-bd23-33d4824698bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.361622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 767/1560] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.362417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c22d0-513b-4d64-b448-0d2768ef3aa2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.365996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 794/1561] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.366788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84f7a8-4dc7-48d8-bd23-33d4824698bd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.374988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c22d0-513b-4d64-b448-0d2768ef3aa2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.376108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84f7a8-4dc7-48d8-bd23-33d4824698bd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.379833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0561d-4ddf-44c3-ba58-72762ca454c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.380502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0561d-4ddf-44c3-ba58-72762ca454c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.380778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0561d-4ddf-44c3-ba58-72762ca454c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.380915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed142f-e781-4c4f-81bc-c1d4fc0f4afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.381069 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0561d-4ddf-44c3-ba58-72762ca454c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.381587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed142f-e781-4c4f-81bc-c1d4fc0f4afb admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.381827 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0561d-4ddf-44c3-ba58-72762ca454c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:27.381928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed142f-e781-4c4f-81bc-c1d4fc0f4afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.382120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0561d-4ddf-44c3-ba58-72762ca454c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.382220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed142f-e781-4c4f-81bc-c1d4fc0f4afb admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.382855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed142f-e781-4c4f-81bc-c1d4fc0f4afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:27.383160 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed142f-e781-4c4f-81bc-c1d4fc0f4afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.383728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0561d-4ddf-44c3-ba58-72762ca454c4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.384745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed142f-e781-4c4f-81bc-c1d4fc0f4afb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.403090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 768/1562] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:27.403308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 795/1563] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:27.403308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975c76b-56f1-4019-8dc8-88cc5cff9210 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.403486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0561d-4ddf-44c3-ba58-72762ca454c4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.403576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975c76b-56f1-4019-8dc8-88cc5cff9210 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.403576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975c76b-56f1-4019-8dc8-88cc5cff9210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.411735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:27.414177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0561d-4ddf-44c3-ba58-72762ca454c4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.417715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c975c76b-56f1-4019-8dc8-88cc5cff9210 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.419100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c975c76b-56f1-4019-8dc8-88cc5cff9210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:27.420124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd211e-32e9-4bef-aa7d-1dc2457a634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.420853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd211e-32e9-4bef-aa7d-1dc2457a634e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.421287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd211e-32e9-4bef-aa7d-1dc2457a634e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.421565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd211e-32e9-4bef-aa7d-1dc2457a634e admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.422417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd211e-32e9-4bef-aa7d-1dc2457a634e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.424073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd211e-32e9-4bef-aa7d-1dc2457a634e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.429280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 796/1564] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:27.429935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975c76b-56f1-4019-8dc8-88cc5cff9210 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.440522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 769/1565] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:27.441445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd211e-32e9-4bef-aa7d-1dc2457a634e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.441623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975c76b-56f1-4019-8dc8-88cc5cff9210 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.448191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac84bd-2bda-40b4-bfdc-63af64bf1ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.449438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac84bd-2bda-40b4-bfdc-63af64bf1ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.450025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac84bd-2bda-40b4-bfdc-63af64bf1ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.450606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac84bd-2bda-40b4-bfdc-63af64bf1ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.452030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac84bd-2bda-40b4-bfdc-63af64bf1ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.456589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac84bd-2bda-40b4-bfdc-63af64bf1ba9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.457089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd211e-32e9-4bef-aa7d-1dc2457a634e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.462799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65656b-b129-43c7-98fd-3c47f0b6fea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.463456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65656b-b129-43c7-98fd-3c47f0b6fea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.463728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65656b-b129-43c7-98fd-3c47f0b6fea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.464015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65656b-b129-43c7-98fd-3c47f0b6fea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.464765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65656b-b129-43c7-98fd-3c47f0b6fea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:27.465071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65656b-b129-43c7-98fd-3c47f0b6fea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.466705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65656b-b129-43c7-98fd-3c47f0b6fea2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.468638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 797/1566] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:27.469458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac84bd-2bda-40b4-bfdc-63af64bf1ba9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.479527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac84bd-2bda-40b4-bfdc-63af64bf1ba9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.482094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 770/1567] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:27.482942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65656b-b129-43c7-98fd-3c47f0b6fea2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.485094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9435464-f08c-4de0-9d43-a07719b6f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.485778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9435464-f08c-4de0-9d43-a07719b6f93c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.486130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9435464-f08c-4de0-9d43-a07719b6f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.486870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9435464-f08c-4de0-9d43-a07719b6f93c admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.487151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9435464-f08c-4de0-9d43-a07719b6f93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:27.487559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9435464-f08c-4de0-9d43-a07719b6f93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.489647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9435464-f08c-4de0-9d43-a07719b6f93c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.498791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65656b-b129-43c7-98fd-3c47f0b6fea2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.510636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 798/1568] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:27.510636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9435464-f08c-4de0-9d43-a07719b6f93c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.510931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37caee0-9463-4a6f-afb3-ace051526803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.510931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37caee0-9463-4a6f-afb3-ace051526803 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.510931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37caee0-9463-4a6f-afb3-ace051526803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.510931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37caee0-9463-4a6f-afb3-ace051526803 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.511300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37caee0-9463-4a6f-afb3-ace051526803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:27.511300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37caee0-9463-4a6f-afb3-ace051526803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.511300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37caee0-9463-4a6f-afb3-ace051526803 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.514411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9435464-f08c-4de0-9d43-a07719b6f93c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.519883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013de5b-8227-4537-89d7-493a5cac44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.520524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013de5b-8227-4537-89d7-493a5cac44c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.520820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013de5b-8227-4537-89d7-493a5cac44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.521090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013de5b-8227-4537-89d7-493a5cac44c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.521799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013de5b-8227-4537-89d7-493a5cac44c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.522792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 771/1569] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:27.523662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013de5b-8227-4537-89d7-493a5cac44c0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.526166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37caee0-9463-4a6f-afb3-ace051526803 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.538191 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37caee0-9463-4a6f-afb3-ace051526803 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.543552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350ca0d-c158-4329-90b7-3a0e10d20311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.544344 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350ca0d-c158-4329-90b7-3a0e10d20311 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.544644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350ca0d-c158-4329-90b7-3a0e10d20311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.544930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350ca0d-c158-4329-90b7-3a0e10d20311 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.545786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350ca0d-c158-4329-90b7-3a0e10d20311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.547695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350ca0d-c158-4329-90b7-3a0e10d20311 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.554333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 799/1570] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:27.554333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013de5b-8227-4537-89d7-493a5cac44c0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.576711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 772/1571] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:27.577369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350ca0d-c158-4329-90b7-3a0e10d20311 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.619890 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013de5b-8227-4537-89d7-493a5cac44c0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.641027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350ca0d-c158-4329-90b7-3a0e10d20311 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.645821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ab63-b373-4474-9321-883225c7510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.646717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ab63-b373-4474-9321-883225c7510e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.646995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ab63-b373-4474-9321-883225c7510e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.647243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ab63-b373-4474-9321-883225c7510e admin admin] PATH_INFO: `/v3/projects/1cc15646e19b4622b61114d3815bcf23/users/64446b1fb28849c380e018a1353fe1c5/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.661943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6ab63-b373-4474-9321-883225c7510e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc15646e19b4622b61114d3815bcf23, user_id=64446b1fb28849c380e018a1353fe1c5, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.662991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-3fa6ab63-b373-4474-9321-883225c7510e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:12:27.662991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: warnings.warn(msg) Jun 17 15:12:27.662991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: Jun 17 15:12:27.664886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6ab63-b373-4474-9321-883225c7510e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.678323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3b45b-4136-4f8d-889b-d1b804e7035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.678903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 773/1572] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:27 2022] PUT /identity/v3/projects/1cc15646e19b4622b61114d3815bcf23/users/64446b1fb28849c380e018a1353fe1c5/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:27.679501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3b45b-4136-4f8d-889b-d1b804e7035d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.679501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3b45b-4136-4f8d-889b-d1b804e7035d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.679685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3b45b-4136-4f8d-889b-d1b804e7035d admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.680268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3b45b-4136-4f8d-889b-d1b804e7035d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:27.680572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3b45b-4136-4f8d-889b-d1b804e7035d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.682092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ab63-b373-4474-9321-883225c7510e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.682204 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3b45b-4136-4f8d-889b-d1b804e7035d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.694616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 800/1573] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:27.695339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3b45b-4136-4f8d-889b-d1b804e7035d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.707016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3b45b-4136-4f8d-889b-d1b804e7035d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.750838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ab63-b373-4474-9321-883225c7510e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.755518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dc27c-688c-451d-af07-b163fb8ca321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.756195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dc27c-688c-451d-af07-b163fb8ca321 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.756477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dc27c-688c-451d-af07-b163fb8ca321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.756752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dc27c-688c-451d-af07-b163fb8ca321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.757517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dc27c-688c-451d-af07-b163fb8ca321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.759169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dc27c-688c-451d-af07-b163fb8ca321 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.759426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:27.764506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:27.767878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002a1e0-acd7-44e5-b3c0-f3e1da4d6ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.768768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a1e0-acd7-44e5-b3c0-f3e1da4d6ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.769129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a1e0-acd7-44e5-b3c0-f3e1da4d6ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.769453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a1e0-acd7-44e5-b3c0-f3e1da4d6ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.770130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002a1e0-acd7-44e5-b3c0-f3e1da4d6ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.771556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 774/1574] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:27.773522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002a1e0-acd7-44e5-b3c0-f3e1da4d6ec3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.773662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dc27c-688c-451d-af07-b163fb8ca321 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.783223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dc27c-688c-451d-af07-b163fb8ca321 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.787787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a16c9-7e25-4474-b686-edd93ac0eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.788464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a16c9-7e25-4474-b686-edd93ac0eda6 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.788763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a16c9-7e25-4474-b686-edd93ac0eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.789133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a16c9-7e25-4474-b686-edd93ac0eda6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.789856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a16c9-7e25-4474-b686-edd93ac0eda6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.791822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a16c9-7e25-4474-b686-edd93ac0eda6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.802598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 801/1575] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:27.803422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002a1e0-acd7-44e5-b3c0-f3e1da4d6ec3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.824940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 775/1576] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:27.824940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a16c9-7e25-4474-b686-edd93ac0eda6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.865689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002a1e0-acd7-44e5-b3c0-f3e1da4d6ec3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.884442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a16c9-7e25-4474-b686-edd93ac0eda6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.889192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53686005-ad03-4511-873b-16fcc5265814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.889888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53686005-ad03-4511-873b-16fcc5265814 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.890168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53686005-ad03-4511-873b-16fcc5265814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.890416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53686005-ad03-4511-873b-16fcc5265814 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.891157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53686005-ad03-4511-873b-16fcc5265814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.893199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53686005-ad03-4511-873b-16fcc5265814 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.914803 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 776/1577] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:27.915604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53686005-ad03-4511-873b-16fcc5265814 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.922994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0745e8-f851-4067-b5dc-cbec97e381e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.923705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0745e8-f851-4067-b5dc-cbec97e381e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.923986 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0745e8-f851-4067-b5dc-cbec97e381e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.924264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0745e8-f851-4067-b5dc-cbec97e381e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.924954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0745e8-f851-4067-b5dc-cbec97e381e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.926981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0745e8-f851-4067-b5dc-cbec97e381e5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.927502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53686005-ad03-4511-873b-16fcc5265814 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.932016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbf51f-cfd2-4aa2-a512-fceb2da66b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:27.932668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf51f-cfd2-4aa2-a512-fceb2da66b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.932946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf51f-cfd2-4aa2-a512-fceb2da66b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.933231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf51f-cfd2-4aa2-a512-fceb2da66b14 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.933921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbf51f-cfd2-4aa2-a512-fceb2da66b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:27.935815 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbf51f-cfd2-4aa2-a512-fceb2da66b14 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:27.957472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 802/1578] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:27.957472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543aa11-a395-48a1-8958-66b5a1fdaca3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:27.957472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543aa11-a395-48a1-8958-66b5a1fdaca3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:27.957829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 777/1579] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:27.957939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543aa11-a395-48a1-8958-66b5a1fdaca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:27.958048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbf51f-cfd2-4aa2-a512-fceb2da66b14 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:27.968911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbf51f-cfd2-4aa2-a512-fceb2da66b14 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:27.984223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0543aa11-a395-48a1-8958-66b5a1fdaca3 None None] MFA Rules not processed for user `64446b1fb28849c380e018a1353fe1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:27.991622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0543aa11-a395-48a1-8958-66b5a1fdaca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:28.029583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c66c9b-b01c-4302-8694-dd4f214903c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.030516 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66c9b-b01c-4302-8694-dd4f214903c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.030788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66c9b-b01c-4302-8694-dd4f214903c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.031056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66c9b-b01c-4302-8694-dd4f214903c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.031751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66c9b-b01c-4302-8694-dd4f214903c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.033881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66c9b-b01c-4302-8694-dd4f214903c4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.048397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 803/1580] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:28.049625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543aa11-a395-48a1-8958-66b5a1fdaca3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.055139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:28.061289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543aa11-a395-48a1-8958-66b5a1fdaca3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.062084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 778/1581] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:27 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:28.066166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c66c9b-b01c-4302-8694-dd4f214903c4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.105069 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:28.118299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c355c-0c83-4371-a4cd-68ef22b75fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.119240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c355c-0c83-4371-a4cd-68ef22b75fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.119518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c355c-0c83-4371-a4cd-68ef22b75fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.119792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c355c-0c83-4371-a4cd-68ef22b75fb3 admin admin] PATH_INFO: `/v3/projects/2eea96762b8a42338e8b6fd2c501b43e/users/d770c98d01ea4c9bb20b79dab4bfc0ad/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.129223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c66c9b-b01c-4302-8694-dd4f214903c4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.134224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b58fa-4c20-431d-8eec-d5eeac0d777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.134415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c355c-0c83-4371-a4cd-68ef22b75fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eea96762b8a42338e8b6fd2c501b43e, user_id=d770c98d01ea4c9bb20b79dab4bfc0ad, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.134913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b58fa-4c20-431d-8eec-d5eeac0d777f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.135191 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b58fa-4c20-431d-8eec-d5eeac0d777f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.135468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b58fa-4c20-431d-8eec-d5eeac0d777f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.136157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b58fa-4c20-431d-8eec-d5eeac0d777f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.137084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c355c-0c83-4371-a4cd-68ef22b75fb3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.138185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b58fa-4c20-431d-8eec-d5eeac0d777f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.151603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 804/1582] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:28 2022] PUT /identity/v3/projects/2eea96762b8a42338e8b6fd2c501b43e/users/d770c98d01ea4c9bb20b79dab4bfc0ad/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:28.155660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c355c-0c83-4371-a4cd-68ef22b75fb3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.159293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 779/1583] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:28 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:28.159990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b58fa-4c20-431d-8eec-d5eeac0d777f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.170858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b58fa-4c20-431d-8eec-d5eeac0d777f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.215972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c355c-0c83-4371-a4cd-68ef22b75fb3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.220811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759805-3288-4cc5-b3c7-df2fd33838c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.221511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759805-3288-4cc5-b3c7-df2fd33838c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.221795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759805-3288-4cc5-b3c7-df2fd33838c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.222104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759805-3288-4cc5-b3c7-df2fd33838c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.222928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98759805-3288-4cc5-b3c7-df2fd33838c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.224861 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98759805-3288-4cc5-b3c7-df2fd33838c0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.228519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10941-d44e-460b-a245-aa493aa96fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.229184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10941-d44e-460b-a245-aa493aa96fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.229554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10941-d44e-460b-a245-aa493aa96fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.229908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10941-d44e-460b-a245-aa493aa96fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.230689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a10941-d44e-460b-a245-aa493aa96fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.232330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a10941-d44e-460b-a245-aa493aa96fd3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.243519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 780/1584] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.244426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10941-d44e-460b-a245-aa493aa96fd3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.247125 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 805/1585] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:28 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:28.247840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759805-3288-4cc5-b3c7-df2fd33838c0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.254346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10941-d44e-460b-a245-aa493aa96fd3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.257815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759805-3288-4cc5-b3c7-df2fd33838c0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.259124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f31317-372e-49d8-825e-fb0b544f69ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.259783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f31317-372e-49d8-825e-fb0b544f69ef admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.260063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f31317-372e-49d8-825e-fb0b544f69ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.260367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f31317-372e-49d8-825e-fb0b544f69ef admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.261175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f31317-372e-49d8-825e-fb0b544f69ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.263135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f31317-372e-49d8-825e-fb0b544f69ef admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.263691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785664b8-0f1f-46ea-84e5-24270e599720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.264350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785664b8-0f1f-46ea-84e5-24270e599720 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.264688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785664b8-0f1f-46ea-84e5-24270e599720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.264961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785664b8-0f1f-46ea-84e5-24270e599720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.265720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785664b8-0f1f-46ea-84e5-24270e599720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.267320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785664b8-0f1f-46ea-84e5-24270e599720 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.278278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 806/1586] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.279075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785664b8-0f1f-46ea-84e5-24270e599720 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.285555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 781/1587] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:28 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:28.286405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f31317-372e-49d8-825e-fb0b544f69ef admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.292317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785664b8-0f1f-46ea-84e5-24270e599720 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.296199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f31317-372e-49d8-825e-fb0b544f69ef admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.297230 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fa9d8-d116-48f0-b722-5f3def1f65fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.297957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fa9d8-d116-48f0-b722-5f3def1f65fd admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.298284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fa9d8-d116-48f0-b722-5f3def1f65fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.298583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fa9d8-d116-48f0-b722-5f3def1f65fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.299483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fa9d8-d116-48f0-b722-5f3def1f65fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.301313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481e06-130a-49f0-ae12-5946ed0d04c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.301456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fa9d8-d116-48f0-b722-5f3def1f65fd admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.301971 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481e06-130a-49f0-ae12-5946ed0d04c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.302249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481e06-130a-49f0-ae12-5946ed0d04c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.302522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481e06-130a-49f0-ae12-5946ed0d04c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.303202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481e06-130a-49f0-ae12-5946ed0d04c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.305112 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481e06-130a-49f0-ae12-5946ed0d04c0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.327159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 782/1588] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:28 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:28.328379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 807/1589] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:28 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:28.331886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d8d5-f609-4cbd-aefd-22e612dd80a6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.332212 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d8d5-f609-4cbd-aefd-22e612dd80a6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.332699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d8d5-f609-4cbd-aefd-22e612dd80a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.333420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fa9d8-d116-48f0-b722-5f3def1f65fd admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.349943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2584d8d5-f609-4cbd-aefd-22e612dd80a6 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:28.351152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2584d8d5-f609-4cbd-aefd-22e612dd80a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:28.378790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:28.397510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fa9d8-d116-48f0-b722-5f3def1f65fd admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.402492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7ceed-d3b3-42fb-9086-3918a079f5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.403168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7ceed-d3b3-42fb-9086-3918a079f5db admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.403460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7ceed-d3b3-42fb-9086-3918a079f5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.403779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7ceed-d3b3-42fb-9086-3918a079f5db admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.404488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7ceed-d3b3-42fb-9086-3918a079f5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.406161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7ceed-d3b3-42fb-9086-3918a079f5db admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.411493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 783/1590] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:28.412332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584d8d5-f609-4cbd-aefd-22e612dd80a6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.419749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 808/1591] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.420580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7ceed-d3b3-42fb-9086-3918a079f5db admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.422057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584d8d5-f609-4cbd-aefd-22e612dd80a6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.426852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abbdba-2999-4547-b716-292abe8d6537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.427515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abbdba-2999-4547-b716-292abe8d6537 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.427792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abbdba-2999-4547-b716-292abe8d6537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.428067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abbdba-2999-4547-b716-292abe8d6537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.428825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abbdba-2999-4547-b716-292abe8d6537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.430466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abbdba-2999-4547-b716-292abe8d6537 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.432400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7ceed-d3b3-42fb-9086-3918a079f5db admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.437489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4f6f4-6b85-42ff-84e5-d548d9eec43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.438164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4f6f4-6b85-42ff-84e5-d548d9eec43b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.438471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4f6f4-6b85-42ff-84e5-d548d9eec43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.438754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4f6f4-6b85-42ff-84e5-d548d9eec43b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.439484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4f6f4-6b85-42ff-84e5-d548d9eec43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.440763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 784/1592] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.441591 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abbdba-2999-4547-b716-292abe8d6537 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.444353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4f6f4-6b85-42ff-84e5-d548d9eec43b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.451048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abbdba-2999-4547-b716-292abe8d6537 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.455989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fc189-99c2-4319-9a3e-3e5ad5e954c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.456526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 809/1593] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.456648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fc189-99c2-4319-9a3e-3e5ad5e954c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.456889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fc189-99c2-4319-9a3e-3e5ad5e954c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.457159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fc189-99c2-4319-9a3e-3e5ad5e954c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.457429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4f6f4-6b85-42ff-84e5-d548d9eec43b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.457907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fc189-99c2-4319-9a3e-3e5ad5e954c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.459576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fc189-99c2-4319-9a3e-3e5ad5e954c3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.467464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4f6f4-6b85-42ff-84e5-d548d9eec43b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.469687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 785/1594] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.472355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fc189-99c2-4319-9a3e-3e5ad5e954c3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.472705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280035-232b-4959-8be9-fda5aadd4ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.473386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280035-232b-4959-8be9-fda5aadd4ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.473673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280035-232b-4959-8be9-fda5aadd4ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.473949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280035-232b-4959-8be9-fda5aadd4ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.474705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e280035-232b-4959-8be9-fda5aadd4ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.476284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e280035-232b-4959-8be9-fda5aadd4ca8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.478855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:28.482724 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fc189-99c2-4319-9a3e-3e5ad5e954c3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.487391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 810/1595] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.488276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280035-232b-4959-8be9-fda5aadd4ca8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.491791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da8b7c-b7c3-43b6-9ea6-f8f69515bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.492454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da8b7c-b7c3-43b6-9ea6-f8f69515bf41 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.492733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da8b7c-b7c3-43b6-9ea6-f8f69515bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.493005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da8b7c-b7c3-43b6-9ea6-f8f69515bf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.493813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da8b7c-b7c3-43b6-9ea6-f8f69515bf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.495509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da8b7c-b7c3-43b6-9ea6-f8f69515bf41 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.498327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280035-232b-4959-8be9-fda5aadd4ca8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.503240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638347e-df82-45af-b390-9d9de900fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.503895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638347e-df82-45af-b390-9d9de900fa92 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.504170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638347e-df82-45af-b390-9d9de900fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.504439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638347e-df82-45af-b390-9d9de900fa92 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.505144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638347e-df82-45af-b390-9d9de900fa92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.506332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 786/1596] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.507065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638347e-df82-45af-b390-9d9de900fa92 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.507183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da8b7c-b7c3-43b6-9ea6-f8f69515bf41 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.516660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da8b7c-b7c3-43b6-9ea6-f8f69515bf41 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.522386 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c4fec-b259-43ea-b614-adab0f38ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.523048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c4fec-b259-43ea-b614-adab0f38ccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.523356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c4fec-b259-43ea-b614-adab0f38ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.523600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c4fec-b259-43ea-b614-adab0f38ccf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.524506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c4fec-b259-43ea-b614-adab0f38ccf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.526195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c4fec-b259-43ea-b614-adab0f38ccf8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.536655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 787/1597] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.537580 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c4fec-b259-43ea-b614-adab0f38ccf8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.599455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c4fec-b259-43ea-b614-adab0f38ccf8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.604088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52424f-87ef-4611-8d6b-9ea4624df8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.604760 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52424f-87ef-4611-8d6b-9ea4624df8cb service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.605032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52424f-87ef-4611-8d6b-9ea4624df8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.605330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52424f-87ef-4611-8d6b-9ea4624df8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.615592 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52424f-87ef-4611-8d6b-9ea4624df8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.617055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52424f-87ef-4611-8d6b-9ea4624df8cb service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.628423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 788/1598] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:28.629320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52424f-87ef-4611-8d6b-9ea4624df8cb service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.639653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52424f-87ef-4611-8d6b-9ea4624df8cb service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.645056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daea61-7357-4f48-9166-1f0111f5d664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.646116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daea61-7357-4f48-9166-1f0111f5d664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.646373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daea61-7357-4f48-9166-1f0111f5d664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.646643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daea61-7357-4f48-9166-1f0111f5d664 admin admin] PATH_INFO: `/v3/projects/02b2be78491c4b9da9fa91a7c8892640/users/81f7520d68b3473cbba90d8581afbfac/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.659083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 811/1599] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:28 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:28.659557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638347e-df82-45af-b390-9d9de900fa92 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.670763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638347e-df82-45af-b390-9d9de900fa92 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.671006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daea61-7357-4f48-9166-1f0111f5d664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b2be78491c4b9da9fa91a7c8892640, user_id=81f7520d68b3473cbba90d8581afbfac, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.675116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daea61-7357-4f48-9166-1f0111f5d664 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.675750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f558d7-7d3f-4e53-af00-7281d558e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.676421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f558d7-7d3f-4e53-af00-7281d558e28e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.676697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f558d7-7d3f-4e53-af00-7281d558e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.676966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f558d7-7d3f-4e53-af00-7281d558e28e admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.677722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f558d7-7d3f-4e53-af00-7281d558e28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.679420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f558d7-7d3f-4e53-af00-7281d558e28e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.691427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 789/1600] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:28 2022] PUT /identity/v3/projects/02b2be78491c4b9da9fa91a7c8892640/users/81f7520d68b3473cbba90d8581afbfac/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:28.695848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 812/1601] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.695848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f558d7-7d3f-4e53-af00-7281d558e28e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.696047 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daea61-7357-4f48-9166-1f0111f5d664 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.707650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f558d7-7d3f-4e53-af00-7281d558e28e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.768204 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daea61-7357-4f48-9166-1f0111f5d664 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.769612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6e2da-d064-4973-963a-99a543cf8f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.770338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6e2da-d064-4973-963a-99a543cf8f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.770621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6e2da-d064-4973-963a-99a543cf8f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.770894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6e2da-d064-4973-963a-99a543cf8f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.771649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6e2da-d064-4973-963a-99a543cf8f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.773300 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6e2da-d064-4973-963a-99a543cf8f54 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.774332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f4465-d927-4748-9910-60014fde487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.775524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f4465-d927-4748-9910-60014fde487b admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.775866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f4465-d927-4748-9910-60014fde487b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.776145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f4465-d927-4748-9910-60014fde487b admin admin] PATH_INFO: `/v3/projects/0feab24ff4814097a85bbe1f2d634a42/users/0a6708681b7549fcba86b5a7f3d0d0ae/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.785003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 813/1602] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.786017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6e2da-d064-4973-963a-99a543cf8f54 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.795635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f4465-d927-4748-9910-60014fde487b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0feab24ff4814097a85bbe1f2d634a42, user_id=0a6708681b7549fcba86b5a7f3d0d0ae, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.797745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6e2da-d064-4973-963a-99a543cf8f54 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.799335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f4465-d927-4748-9910-60014fde487b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.802742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0006056-d022-4acb-b3e7-7bb6aa56656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.803522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0006056-d022-4acb-b3e7-7bb6aa56656e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.803777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0006056-d022-4acb-b3e7-7bb6aa56656e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.804048 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0006056-d022-4acb-b3e7-7bb6aa56656e admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.804780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0006056-d022-4acb-b3e7-7bb6aa56656e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.806455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0006056-d022-4acb-b3e7-7bb6aa56656e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.816561 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 790/1603] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:28 2022] PUT /identity/v3/projects/0feab24ff4814097a85bbe1f2d634a42/users/0a6708681b7549fcba86b5a7f3d0d0ae/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:28.818614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 814/1604] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.821401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0006056-d022-4acb-b3e7-7bb6aa56656e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.821489 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f4465-d927-4748-9910-60014fde487b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.832519 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0006056-d022-4acb-b3e7-7bb6aa56656e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.883006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:28.900744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73938176-04a0-4776-863d-940f050af0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.901430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73938176-04a0-4776-863d-940f050af0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.901731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73938176-04a0-4776-863d-940f050af0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.902011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73938176-04a0-4776-863d-940f050af0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.902982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73938176-04a0-4776-863d-940f050af0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.904583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73938176-04a0-4776-863d-940f050af0a3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.905812 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f4465-d927-4748-9910-60014fde487b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.911627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5041c-b0a7-403c-98bc-c2688d5ee0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.912543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5041c-b0a7-403c-98bc-c2688d5ee0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.912811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5041c-b0a7-403c-98bc-c2688d5ee0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.913083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5041c-b0a7-403c-98bc-c2688d5ee0f5 admin admin] PATH_INFO: `/v3/projects/bccfb6d925284ea396f3f9774b37a373/users/84bbbeae948e4806ba649be02c1b3b28/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.916061 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 815/1605] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:28.918175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73938176-04a0-4776-863d-940f050af0a3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:28.930798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73938176-04a0-4776-863d-940f050af0a3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:28.932414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5041c-b0a7-403c-98bc-c2688d5ee0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bccfb6d925284ea396f3f9774b37a373, user_id=84bbbeae948e4806ba649be02c1b3b28, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.935153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5041c-b0a7-403c-98bc-c2688d5ee0f5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.935909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d3e37-6acb-4fcc-ab29-7092292d9c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:28.936932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d3e37-6acb-4fcc-ab29-7092292d9c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.937334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d3e37-6acb-4fcc-ab29-7092292d9c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.937712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d3e37-6acb-4fcc-ab29-7092292d9c0e admin admin] PATH_INFO: `/v3/projects/adf2747597b54241886457386924b42c/users/92dea2c602d742e3891cdc1c91e0dc1b/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.947003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:28.961186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 791/1606] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:28 2022] PUT /identity/v3/projects/bccfb6d925284ea396f3f9774b37a373/users/84bbbeae948e4806ba649be02c1b3b28/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:28.963326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68451c73-1caa-4404-96c2-69d6f45a30f9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:28.963837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68451c73-1caa-4404-96c2-69d6f45a30f9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:28.964302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68451c73-1caa-4404-96c2-69d6f45a30f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:28.981720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d3e37-6acb-4fcc-ab29-7092292d9c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf2747597b54241886457386924b42c, user_id=92dea2c602d742e3891cdc1c91e0dc1b, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:28.984991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d3e37-6acb-4fcc-ab29-7092292d9c0e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:28.990811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-68451c73-1caa-4404-96c2-69d6f45a30f9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:28.993339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-68451c73-1caa-4404-96c2-69d6f45a30f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:29.012596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 816/1607] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:28 2022] PUT /identity/v3/projects/adf2747597b54241886457386924b42c/users/92dea2c602d742e3891cdc1c91e0dc1b/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:29.012596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d3e37-6acb-4fcc-ab29-7092292d9c0e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:29.079466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 792/1608] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:29.079466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106917-beff-431f-851c-cf2178172162 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.079466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106917-beff-431f-851c-cf2178172162 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.079466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106917-beff-431f-851c-cf2178172162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.103273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cd106917-beff-431f-851c-cf2178172162 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:29.104487 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cd106917-beff-431f-851c-cf2178172162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:29.109731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d3e37-6acb-4fcc-ab29-7092292d9c0e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:29.114518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 793/1609] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:29.118046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106917-beff-431f-851c-cf2178172162 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:29.119633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202fc50-a4b5-44a4-a24c-a8bf3357de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:29.120634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202fc50-a4b5-44a4-a24c-a8bf3357de18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.120921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202fc50-a4b5-44a4-a24c-a8bf3357de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.121337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202fc50-a4b5-44a4-a24c-a8bf3357de18 admin admin] PATH_INFO: `/v3/projects/88a7da351c07420e8995b68eb940f4e8/users/e54c15b29a374bc986040462451db2a1/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.130645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106917-beff-431f-851c-cf2178172162 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:29.136174 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15e3ea-14ac-4715-b7dc-e1602a8b30bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:29.137152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e3ea-14ac-4715-b7dc-e1602a8b30bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.137520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e3ea-14ac-4715-b7dc-e1602a8b30bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.137863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e3ea-14ac-4715-b7dc-e1602a8b30bc admin admin] PATH_INFO: `/v3/projects/3a34f82332c946f3a5d16999741b7dd2/users/aa2a6cde40db40acba920f08971905af/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.140104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202fc50-a4b5-44a4-a24c-a8bf3357de18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a7da351c07420e8995b68eb940f4e8, user_id=e54c15b29a374bc986040462451db2a1, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:29.145345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202fc50-a4b5-44a4-a24c-a8bf3357de18 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:29.155139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e3ea-14ac-4715-b7dc-e1602a8b30bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a34f82332c946f3a5d16999741b7dd2, user_id=aa2a6cde40db40acba920f08971905af, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:29.158446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e3ea-14ac-4715-b7dc-e1602a8b30bc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:29.168281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 817/1610] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:29 2022] PUT /identity/v3/projects/88a7da351c07420e8995b68eb940f4e8/users/e54c15b29a374bc986040462451db2a1/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:29.168281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202fc50-a4b5-44a4-a24c-a8bf3357de18 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:29.185261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 794/1611] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:29 2022] PUT /identity/v3/projects/3a34f82332c946f3a5d16999741b7dd2/users/aa2a6cde40db40acba920f08971905af/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:29.185261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ab38-1c4e-48c4-aed7-5c87e2812308 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.185261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ab38-1c4e-48c4-aed7-5c87e2812308 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.185261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ab38-1c4e-48c4-aed7-5c87e2812308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.215336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c2e7ab38-1c4e-48c4-aed7-5c87e2812308 None None] MFA Rules not processed for user `84bbbeae948e4806ba649be02c1b3b28`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:29.216755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c2e7ab38-1c4e-48c4-aed7-5c87e2812308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:29.247640 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202fc50-a4b5-44a4-a24c-a8bf3357de18 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:29.293585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 795/1612] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:29.293585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddbfb5-eb95-4737-a4bf-d79cd406bf00 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.293585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddbfb5-eb95-4737-a4bf-d79cd406bf00 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.293585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddbfb5-eb95-4737-a4bf-d79cd406bf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.321033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a9ddbfb5-eb95-4737-a4bf-d79cd406bf00 None None] MFA Rules not processed for user `92dea2c602d742e3891cdc1c91e0dc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:29.322274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a9ddbfb5-eb95-4737-a4bf-d79cd406bf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:29.323764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb1ee5-88c6-4cc4-b383-5bfe5ac07844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:29.324640 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb1ee5-88c6-4cc4-b383-5bfe5ac07844 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.324912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb1ee5-88c6-4cc4-b383-5bfe5ac07844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.325180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb1ee5-88c6-4cc4-b383-5bfe5ac07844 admin admin] PATH_INFO: `/v3/projects/8f819e910cc44a8b920520abff798412/users/4af6036883654d2da65271ddd660bfe6/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.336298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:29.344847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb1ee5-88c6-4cc4-b383-5bfe5ac07844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f819e910cc44a8b920520abff798412, user_id=4af6036883654d2da65271ddd660bfe6, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:29.353340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb1ee5-88c6-4cc4-b383-5bfe5ac07844 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:29.364671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:29.377295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 818/1613] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:29 2022] PUT /identity/v3/projects/8f819e910cc44a8b920520abff798412/users/4af6036883654d2da65271ddd660bfe6/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:29.378759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb1ee5-88c6-4cc4-b383-5bfe5ac07844 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:29.416589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 796/1614] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:29.417677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddbfb5-eb95-4737-a4bf-d79cd406bf00 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:29.471979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb1ee5-88c6-4cc4-b383-5bfe5ac07844 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:29.481789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bd914-a312-4292-9383-1b79fbbdbfec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:29.482603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bd914-a312-4292-9383-1b79fbbdbfec service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.482880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bd914-a312-4292-9383-1b79fbbdbfec service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.483152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bd914-a312-4292-9383-1b79fbbdbfec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.495342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddbfb5-eb95-4737-a4bf-d79cd406bf00 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:29.501142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79b69b-430c-4ce5-990d-0097e468dd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:29.502178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79b69b-430c-4ce5-990d-0097e468dd28 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.502623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79b69b-430c-4ce5-990d-0097e468dd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.503006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79b69b-430c-4ce5-990d-0097e468dd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.565586 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bd914-a312-4292-9383-1b79fbbdbfec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:29.568349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bd914-a312-4292-9383-1b79fbbdbfec service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:29.578894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 819/1615] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:29.580090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae91a-49a8-49f1-9a38-f74d9c6535f6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.580362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae91a-49a8-49f1-9a38-f74d9c6535f6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.580701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae91a-49a8-49f1-9a38-f74d9c6535f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.589260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79b69b-430c-4ce5-990d-0097e468dd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:29.591484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79b69b-430c-4ce5-990d-0097e468dd28 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:29.601989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 797/1616] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:29.603663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27db4c1-be79-4b40-b977-ba1132614ab3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.603951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27db4c1-be79-4b40-b977-ba1132614ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.604234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27db4c1-be79-4b40-b977-ba1132614ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.606550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6c3ae91a-49a8-49f1-9a38-f74d9c6535f6 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:29.608393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6c3ae91a-49a8-49f1-9a38-f74d9c6535f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:29.620124 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 820/1617] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:29.622084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae91a-49a8-49f1-9a38-f74d9c6535f6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:29.638253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c27db4c1-be79-4b40-b977-ba1132614ab3 None None] MFA Rules not processed for user `aa2a6cde40db40acba920f08971905af`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:29.640155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c27db4c1-be79-4b40-b977-ba1132614ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:29.641369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae91a-49a8-49f1-9a38-f74d9c6535f6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:29.651396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86efb3-91c3-452a-955e-848b5ceb4f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:29.652074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86efb3-91c3-452a-955e-848b5ceb4f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.652405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86efb3-91c3-452a-955e-848b5ceb4f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.652634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86efb3-91c3-452a-955e-848b5ceb4f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.654196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86efb3-91c3-452a-955e-848b5ceb4f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:29.656742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86efb3-91c3-452a-955e-848b5ceb4f57 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:29.693765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 821/1618] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:29 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:29.694710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86efb3-91c3-452a-955e-848b5ceb4f57 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:29.732818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:29.747876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 798/1619] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:29.748811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27db4c1-be79-4b40-b977-ba1132614ab3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:29.779841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86efb3-91c3-452a-955e-848b5ceb4f57 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:29.794954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f65fb-38a3-4871-b8bb-84a514a02c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:29.795729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f65fb-38a3-4871-b8bb-84a514a02c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.796126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f65fb-38a3-4871-b8bb-84a514a02c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.796474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f65fb-38a3-4871-b8bb-84a514a02c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.797324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f65fb-38a3-4871-b8bb-84a514a02c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:29.799298 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f65fb-38a3-4871-b8bb-84a514a02c52 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:29.815843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 822/1620] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:29.817132 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f65fb-38a3-4871-b8bb-84a514a02c52 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:29.819706 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-081f65fb-38a3-4871-b8bb-84a514a02c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:29.829002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27db4c1-be79-4b40-b977-ba1132614ab3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:29.844190 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:29.890513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92c67-b586-4715-bb9f-217f92e7b133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:29.891271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92c67-b586-4715-bb9f-217f92e7b133 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.891632 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92c67-b586-4715-bb9f-217f92e7b133 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.891911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92c67-b586-4715-bb9f-217f92e7b133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.903107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f65fb-38a3-4871-b8bb-84a514a02c52 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:29.909499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcba069-ad45-4cf5-8b82-0347019a482c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:29.910174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcba069-ad45-4cf5-8b82-0347019a482c service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:29.910454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcba069-ad45-4cf5-8b82-0347019a482c service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:29.910730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcba069-ad45-4cf5-8b82-0347019a482c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:29.924757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcba069-ad45-4cf5-8b82-0347019a482c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:29.927268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcba069-ad45-4cf5-8b82-0347019a482c service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:29.946960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 823/1621] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:29.947758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcba069-ad45-4cf5-8b82-0347019a482c service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:29.972939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcba069-ad45-4cf5-8b82-0347019a482c service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:29.991992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa92c67-b586-4715-bb9f-217f92e7b133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:29.993747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa92c67-b586-4715-bb9f-217f92e7b133 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:30.000975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2469e5b-6326-466c-992c-3e4e8ce0d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:30.003078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2469e5b-6326-466c-992c-3e4e8ce0d439 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:30.003370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2469e5b-6326-466c-992c-3e4e8ce0d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:30.003648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2469e5b-6326-466c-992c-3e4e8ce0d439 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:30.004478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2469e5b-6326-466c-992c-3e4e8ce0d439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:30.013051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2469e5b-6326-466c-992c-3e4e8ce0d439 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:30.019157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 799/1622] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:30.024619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780fa46-3d8b-4597-a0f5-b589c59e9da0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:30.024897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780fa46-3d8b-4597-a0f5-b589c59e9da0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:30.025156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780fa46-3d8b-4597-a0f5-b589c59e9da0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:30.030837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 800/1623] 10.222.0.45 () {54 vars in 961 bytes} [Fri Jun 17 15:12:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:12:30.031245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780fa46-3d8b-4597-a0f5-b589c59e9da0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:30.057986 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 824/1624] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:29 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:30.059489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d428d4-4402-4991-b1a6-32ec875d36f6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:30.059777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d428d4-4402-4991-b1a6-32ec875d36f6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:30.060642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d428d4-4402-4991-b1a6-32ec875d36f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:30.073442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780fa46-3d8b-4597-a0f5-b589c59e9da0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:30.093943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed6b00-aa1e-495a-a8a3-af0bb13179ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:30.094927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed6b00-aa1e-495a-a8a3-af0bb13179ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:30.095226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed6b00-aa1e-495a-a8a3-af0bb13179ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:30.095677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed6b00-aa1e-495a-a8a3-af0bb13179ed admin admin] PATH_INFO: `/v3/projects/8f819e910cc44a8b920520abff798412/users/4af6036883654d2da65271ddd660bfe6/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:30.101025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed6b00-aa1e-495a-a8a3-af0bb13179ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f819e910cc44a8b920520abff798412, user_id=4af6036883654d2da65271ddd660bfe6, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:30.105129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-25d428d4-4402-4991-b1a6-32ec875d36f6 None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:30.106397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-25d428d4-4402-4991-b1a6-32ec875d36f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:30.106932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed6b00-aa1e-495a-a8a3-af0bb13179ed admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:30.133361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 801/1625] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:30 2022] PUT /identity/v3/projects/8f819e910cc44a8b920520abff798412/users/4af6036883654d2da65271ddd660bfe6/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:30.145812 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed6b00-aa1e-495a-a8a3-af0bb13179ed admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:30.266205 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:30.276717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 825/1626] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Jun 17 15:12:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:30.278236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5886-3738-4950-8c9e-eb25fea33d66 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:30.278536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5886-3738-4950-8c9e-eb25fea33d66 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:30.278830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5886-3738-4950-8c9e-eb25fea33d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:30.295340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed6b00-aa1e-495a-a8a3-af0bb13179ed admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:30.301541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034e8e5-65f1-4c1c-a1c9-c5944921b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:30.302237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034e8e5-65f1-4c1c-a1c9-c5944921b645 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:30.302526 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034e8e5-65f1-4c1c-a1c9-c5944921b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:30.302811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034e8e5-65f1-4c1c-a1c9-c5944921b645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:30.303554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034e8e5-65f1-4c1c-a1c9-c5944921b645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:30.305238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034e8e5-65f1-4c1c-a1c9-c5944921b645 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:30.329873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 802/1627] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:30.331273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034e8e5-65f1-4c1c-a1c9-c5944921b645 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:30.338968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c09f5886-3738-4950-8c9e-eb25fea33d66 None None] MFA Rules not processed for user `4af6036883654d2da65271ddd660bfe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:30.340214 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c09f5886-3738-4950-8c9e-eb25fea33d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:30.471092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 826/1628] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:30.472173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f5886-3738-4950-8c9e-eb25fea33d66 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:30.485886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f5886-3738-4950-8c9e-eb25fea33d66 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:30.491818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4695-882e-433a-b980-2a4a4fd6d039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:30.492740 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4695-882e-433a-b980-2a4a4fd6d039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:30.493159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4695-882e-433a-b980-2a4a4fd6d039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:30.493634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4695-882e-433a-b980-2a4a4fd6d039 admin admin] PATH_INFO: `/v3/projects/1da449b7199141d8ac19e1694c507232/users/294cceb9161e4004b0d582d33d8d9be7/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:30.507223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034e8e5-65f1-4c1c-a1c9-c5944921b645 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:30.519466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a4695-882e-433a-b980-2a4a4fd6d039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da449b7199141d8ac19e1694c507232, user_id=294cceb9161e4004b0d582d33d8d9be7, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:30.521575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6803-ce34-48f9-8e95-f3328c7179ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:30.522361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6803-ce34-48f9-8e95-f3328c7179ef service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:30.522744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6803-ce34-48f9-8e95-f3328c7179ef service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:30.523044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a4695-882e-433a-b980-2a4a4fd6d039 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:30.523229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6803-ce34-48f9-8e95-f3328c7179ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:30.525530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:30.547148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 827/1629] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:30 2022] PUT /identity/v3/projects/1da449b7199141d8ac19e1694c507232/users/294cceb9161e4004b0d582d33d8d9be7/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:30.548494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4695-882e-433a-b980-2a4a4fd6d039 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:30.720363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4695-882e-433a-b980-2a4a4fd6d039 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:30.720363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd30bbb-63e7-4512-9fb1-d95a23600875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:30.720363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd30bbb-63e7-4512-9fb1-d95a23600875 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:30.720363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd30bbb-63e7-4512-9fb1-d95a23600875 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:30.724547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd30bbb-63e7-4512-9fb1-d95a23600875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:30.724885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba6803-ce34-48f9-8e95-f3328c7179ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:30.724885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba6803-ce34-48f9-8e95-f3328c7179ef service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:30.750840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 803/1630] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:30.754767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6803-ce34-48f9-8e95-f3328c7179ef service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:30.802400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6803-ce34-48f9-8e95-f3328c7179ef service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:30.916339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd30bbb-63e7-4512-9fb1-d95a23600875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:30.918999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd30bbb-63e7-4512-9fb1-d95a23600875 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:30.938572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 828/1631] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:30.944036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcec009-ca03-4dda-9aa6-24bf7e849455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:30.944678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcec009-ca03-4dda-9aa6-24bf7e849455 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:30.944961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcec009-ca03-4dda-9aa6-24bf7e849455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:30.945266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcec009-ca03-4dda-9aa6-24bf7e849455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:30.946089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcec009-ca03-4dda-9aa6-24bf7e849455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:30.947823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcec009-ca03-4dda-9aa6-24bf7e849455 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:30.961054 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 804/1632] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:30.964893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd30bbb-63e7-4512-9fb1-d95a23600875 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:30.993100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd30bbb-63e7-4512-9fb1-d95a23600875 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:30.998247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e996f-ee34-4442-8b87-8b637ee87c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:31.001763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e996f-ee34-4442-8b87-8b637ee87c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:31.002101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e996f-ee34-4442-8b87-8b637ee87c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:31.002407 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e996f-ee34-4442-8b87-8b637ee87c2d admin admin] PATH_INFO: `/v3/projects/1da449b7199141d8ac19e1694c507232/users/294cceb9161e4004b0d582d33d8d9be7/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:31.004985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e996f-ee34-4442-8b87-8b637ee87c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da449b7199141d8ac19e1694c507232, user_id=294cceb9161e4004b0d582d33d8d9be7, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:31.008114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e996f-ee34-4442-8b87-8b637ee87c2d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:31.046338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 829/1633] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:30 2022] PUT /identity/v3/projects/1da449b7199141d8ac19e1694c507232/users/294cceb9161e4004b0d582d33d8d9be7/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:31.058468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5f11-e65a-4c44-b21a-859c9260a884 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:31.058759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5f11-e65a-4c44-b21a-859c9260a884 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:31.059051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5f11-e65a-4c44-b21a-859c9260a884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:31.127847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3eca5f11-e65a-4c44-b21a-859c9260a884 None None] MFA Rules not processed for user `294cceb9161e4004b0d582d33d8d9be7`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:31.129198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3eca5f11-e65a-4c44-b21a-859c9260a884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:31.154633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:31.170181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c603eb9-3d53-47c2-8114-3f3d69f4a1af None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:31.170759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c603eb9-3d53-47c2-8114-3f3d69f4a1af None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:31.171248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c603eb9-3d53-47c2-8114-3f3d69f4a1af None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:31.173558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 830/1634] 10.222.0.45 () {54 vars in 912 bytes} [Fri Jun 17 15:12:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:12:31.180531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4cba0-b81a-4082-a1bb-3c33a4778e0f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:31.181046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4cba0-b81a-4082-a1bb-3c33a4778e0f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:31.181521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4cba0-b81a-4082-a1bb-3c33a4778e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:31.205668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-54a4cba0-b81a-4082-a1bb-3c33a4778e0f None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:31.208326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-54a4cba0-b81a-4082-a1bb-3c33a4778e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:31.348667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 805/1635] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:31.356048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca5f11-e65a-4c44-b21a-859c9260a884 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:31.372467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 831/1636] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:12:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:31.499913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca5f11-e65a-4c44-b21a-859c9260a884 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:31.511463 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd652fd-0683-4d73-a9b1-40f208874571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:31.512377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd652fd-0683-4d73-a9b1-40f208874571 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:31.512715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd652fd-0683-4d73-a9b1-40f208874571 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:31.513004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd652fd-0683-4d73-a9b1-40f208874571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:31.521481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4cba0-b81a-4082-a1bb-3c33a4778e0f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:31.534090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4cba0-b81a-4082-a1bb-3c33a4778e0f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:31.535656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd652fd-0683-4d73-a9b1-40f208874571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:31.537164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd652fd-0683-4d73-a9b1-40f208874571 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:31.539117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ee4ab-afbb-4563-a879-d340845e5e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:31.540002 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ee4ab-afbb-4563-a879-d340845e5e12 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:31.540461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ee4ab-afbb-4563-a879-d340845e5e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:31.540923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ee4ab-afbb-4563-a879-d340845e5e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:31.559139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ee4ab-afbb-4563-a879-d340845e5e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:31.561259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ee4ab-afbb-4563-a879-d340845e5e12 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:31.563842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 806/1637] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:12:31.580888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 832/1638] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:12:31.718222 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd652fd-0683-4d73-a9b1-40f208874571 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:31.734154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd652fd-0683-4d73-a9b1-40f208874571 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:31.740351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7f6c4-4e2e-4bce-a650-b5de42e5df26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:31.741027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7f6c4-4e2e-4bce-a650-b5de42e5df26 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:31.741361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7f6c4-4e2e-4bce-a650-b5de42e5df26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:31.741692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7f6c4-4e2e-4bce-a650-b5de42e5df26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:31.844505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7f6c4-4e2e-4bce-a650-b5de42e5df26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:31.846825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7f6c4-4e2e-4bce-a650-b5de42e5df26 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:31.872789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 807/1639] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:33.014769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afe76f-5103-4939-b094-70532b950994 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:33.015851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afe76f-5103-4939-b094-70532b950994 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:33.016141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afe76f-5103-4939-b094-70532b950994 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:33.017870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 833/1640] 10.222.0.45 () {54 vars in 961 bytes} [Fri Jun 17 15:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:12:33.087449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67543eed-fabf-40d2-b4c4-c101affebea9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:33.087449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67543eed-fabf-40d2-b4c4-c101affebea9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:33.087449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67543eed-fabf-40d2-b4c4-c101affebea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:33.110547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-67543eed-fabf-40d2-b4c4-c101affebea9 None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:33.127714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-67543eed-fabf-40d2-b4c4-c101affebea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:33.142780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 808/1641] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Jun 17 15:12:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:33.156389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe580-cf30-4935-a415-acf3f77a4bb8 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:33.156595 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe580-cf30-4935-a415-acf3f77a4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:33.157806 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe580-cf30-4935-a415-acf3f77a4bb8 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:33.158786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 834/1642] 10.222.0.45 () {54 vars in 912 bytes} [Fri Jun 17 15:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:12:33.175089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58389c29-6d67-4670-afff-738aac2e8092 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:33.175513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58389c29-6d67-4670-afff-738aac2e8092 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:33.175912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58389c29-6d67-4670-afff-738aac2e8092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:33.222937 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-58389c29-6d67-4670-afff-738aac2e8092 None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:33.224502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58389c29-6d67-4670-afff-738aac2e8092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:33.244649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 809/1643] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:12:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:12:33.308906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbe580-cf30-4935-a415-acf3f77a4bb8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:33.329555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbe580-cf30-4935-a415-acf3f77a4bb8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:33.336762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bc8eb-0d5b-43f5-a4b7-f360bed016b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:33.337475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bc8eb-0d5b-43f5-a4b7-f360bed016b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:33.337846 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bc8eb-0d5b-43f5-a4b7-f360bed016b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:33.338026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bc8eb-0d5b-43f5-a4b7-f360bed016b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:33.359488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:33.365537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bc8eb-0d5b-43f5-a4b7-f360bed016b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:33.369407 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bc8eb-0d5b-43f5-a4b7-f360bed016b7 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:33.409310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 835/1644] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:33.533241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58389c29-6d67-4670-afff-738aac2e8092 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:33.609481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:33.641594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58389c29-6d67-4670-afff-738aac2e8092 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:33.650327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02162728-3770-4a7f-afea-626656979909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:33.651874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02162728-3770-4a7f-afea-626656979909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:33.652489 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02162728-3770-4a7f-afea-626656979909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:33.652989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02162728-3770-4a7f-afea-626656979909 admin admin] PATH_INFO: `/v3/users/64446b1fb28849c380e018a1353fe1c5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:33.655003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02162728-3770-4a7f-afea-626656979909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64446b1fb28849c380e018a1353fe1c5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:33.656924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-02162728-3770-4a7f-afea-626656979909 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:12:33.656924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: warnings.warn(msg) Jun 17 15:12:33.656924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: Jun 17 15:12:33.660046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02162728-3770-4a7f-afea-626656979909 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:33.788112 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-02162728-3770-4a7f-afea-626656979909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64446b1fb28849c380e018a1353fe1c5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:33.824123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-02162728-3770-4a7f-afea-626656979909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64446b1fb28849c380e018a1353fe1c5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:33.825560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-02162728-3770-4a7f-afea-626656979909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64446b1fb28849c380e018a1353fe1c5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:33.846399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-02162728-3770-4a7f-afea-626656979909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64446b1fb28849c380e018a1353fe1c5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:33.873391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-02162728-3770-4a7f-afea-626656979909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64446b1fb28849c380e018a1353fe1c5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:33.889718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 810/1645] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:12:33 2022] DELETE /identity/v3/users/64446b1fb28849c380e018a1353fe1c5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:33.891053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b370f-b4c8-445a-b5b5-3a87ef869fae None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:33.891197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b370f-b4c8-445a-b5b5-3a87ef869fae None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:33.891411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b370f-b4c8-445a-b5b5-3a87ef869fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:33.914212 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a99b370f-b4c8-445a-b5b5-3a87ef869fae None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:33.915597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a99b370f-b4c8-445a-b5b5-3a87ef869fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:34.003151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 836/1646] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:34.031606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02162728-3770-4a7f-afea-626656979909 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:34.036291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-02162728-3770-4a7f-afea-626656979909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:34.164930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02162728-3770-4a7f-afea-626656979909 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:34.194415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a883a-7074-4049-bdf1-a991843e00e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:34.195485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a883a-7074-4049-bdf1-a991843e00e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:34.195830 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a883a-7074-4049-bdf1-a991843e00e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:34.196203 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a883a-7074-4049-bdf1-a991843e00e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:34.222729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a883a-7074-4049-bdf1-a991843e00e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:34.224549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a883a-7074-4049-bdf1-a991843e00e1 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:34.249651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 811/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:35.086432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b370f-b4c8-445a-b5b5-3a87ef869fae None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:35.088494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a99b370f-b4c8-445a-b5b5-3a87ef869fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:35.115797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b370f-b4c8-445a-b5b5-3a87ef869fae None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:35.137796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:35.138704 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:35.138983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:35.139253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] PATH_INFO: `/v3/users/aa2a6cde40db40acba920f08971905af` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:35.157441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2a6cde40db40acba920f08971905af)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:35.159513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:35.338111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2a6cde40db40acba920f08971905af'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:35.357426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2a6cde40db40acba920f08971905af'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:35.359443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2a6cde40db40acba920f08971905af'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:35.388182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2a6cde40db40acba920f08971905af'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:35.389021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2a6cde40db40acba920f08971905af'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:35.421253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 837/1648] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:12:35 2022] DELETE /identity/v3/users/aa2a6cde40db40acba920f08971905af => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:35.426569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abcbad-ff0d-487e-9a10-fa9c000b31fd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:35.427091 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abcbad-ff0d-487e-9a10-fa9c000b31fd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:35.427297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abcbad-ff0d-487e-9a10-fa9c000b31fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:35.458468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-58abcbad-ff0d-487e-9a10-fa9c000b31fd None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:35.460095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58abcbad-ff0d-487e-9a10-fa9c000b31fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:35.539878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:35.551010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 812/1649] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:35.579798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:35.581800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:35.613034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abcbad-ff0d-487e-9a10-fa9c000b31fd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:35.616538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58abcbad-ff0d-487e-9a10-fa9c000b31fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:35.649017 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abcbad-ff0d-487e-9a10-fa9c000b31fd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:35.659639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:35.662578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:35.663015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:35.664225 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] PATH_INFO: `/v3/projects/1cc15646e19b4622b61114d3815bcf23` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:35.666875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc15646e19b4622b61114d3815bcf23)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:35.670893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:35.755781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71685cda-ba93-4e14-8f01-3b6c66b96f38 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:35.804410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc15646e19b4622b61114d3815bcf23', 'request_id': 'req-4e9fbe97-a367-4251-9362-940634825302'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:35.812467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:35.835385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc15646e19b4622b61114d3815bcf23', 'request_id': 'req-4e9fbe97-a367-4251-9362-940634825302'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:35.855312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc15646e19b4622b61114d3815bcf23', 'request_id': 'req-4e9fbe97-a367-4251-9362-940634825302'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:35.876995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] The token cache is being invalidate because project 1cc15646e19b4622b61114d3815bcf23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:12:35.878234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:35.879107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:35.885681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012eda8-910e-4bb7-88fc-702efa997678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:35.886184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 813/1650] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:12:35 2022] DELETE /identity/v3/projects/1cc15646e19b4622b61114d3815bcf23 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:35.886364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012eda8-910e-4bb7-88fc-702efa997678 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:35.886650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012eda8-910e-4bb7-88fc-702efa997678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:35.887532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:35.888213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012eda8-910e-4bb7-88fc-702efa997678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:35.890328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:35.891562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a012eda8-910e-4bb7-88fc-702efa997678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:36.028304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fbe97-a367-4251-9362-940634825302 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:36.043117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:36.043642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:36.045024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:36.045631 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] PATH_INFO: `/v3/users/4af6036883654d2da65271ddd660bfe6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:36.046540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012eda8-910e-4bb7-88fc-702efa997678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:36.048833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012eda8-910e-4bb7-88fc-702efa997678 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:36.050486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af6036883654d2da65271ddd660bfe6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:36.052560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:36.073767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 838/1651] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:36.136048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af6036883654d2da65271ddd660bfe6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:36.155308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af6036883654d2da65271ddd660bfe6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:36.156306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af6036883654d2da65271ddd660bfe6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:36.177156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af6036883654d2da65271ddd660bfe6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:36.200697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af6036883654d2da65271ddd660bfe6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:36.205668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:36.236715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 814/1652] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:12:35 2022] DELETE /identity/v3/users/4af6036883654d2da65271ddd660bfe6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:37.653341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012eda8-910e-4bb7-88fc-702efa997678 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:37.654781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a012eda8-910e-4bb7-88fc-702efa997678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:37.687714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012eda8-910e-4bb7-88fc-702efa997678 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:37.925500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:37.927034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:37.927880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:37.928311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] PATH_INFO: `/v3/users/84bbbeae948e4806ba649be02c1b3b28` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:37.932729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84bbbeae948e4806ba649be02c1b3b28)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:37.935987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:37.944615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:37.946201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:37.978411 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42f8ab-8b4a-41ad-85b3-feaaf57b0328 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:37.994333 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:37.995352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:37.995815 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:38.002073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] PATH_INFO: `/v3/projects/8f819e910cc44a8b920520abff798412` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:38.012941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f819e910cc44a8b920520abff798412)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:38.018890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:38.077011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84bbbeae948e4806ba649be02c1b3b28'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.104019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84bbbeae948e4806ba649be02c1b3b28'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.106945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84bbbeae948e4806ba649be02c1b3b28'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.142553 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84bbbeae948e4806ba649be02c1b3b28'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.144600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84bbbeae948e4806ba649be02c1b3b28'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.186981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:38.189176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f819e910cc44a8b920520abff798412', 'request_id': 'req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.203297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f819e910cc44a8b920520abff798412', 'request_id': 'req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.220835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f819e910cc44a8b920520abff798412', 'request_id': 'req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.224792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 839/1653] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:12:37 2022] DELETE /identity/v3/users/84bbbeae948e4806ba649be02c1b3b28 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:38.226008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:38.245801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] The token cache is being invalidate because project 8f819e910cc44a8b920520abff798412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:12:38.246190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.247628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:38.252756 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-954a5bf4-ccf5-4d31-b46b-3bf838d8f9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.254728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 815/1654] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:12:37 2022] DELETE /identity/v3/projects/8f819e910cc44a8b920520abff798412 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:12:38.258088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a3c4-baf0-4a4c-bd31-838bf3719b42 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:38.258088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a3c4-baf0-4a4c-bd31-838bf3719b42 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:38.258088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a3c4-baf0-4a4c-bd31-838bf3719b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:38.327020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d1e0a3c4-baf0-4a4c-bd31-838bf3719b42 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:38.331374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1e0a3c4-baf0-4a4c-bd31-838bf3719b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:38.562328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddfbb0-e084-4550-b898-1a0d0bc8e1c4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:38.576504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:38.577513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:38.577732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:38.578010 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] PATH_INFO: `/v3/projects/3a34f82332c946f3a5d16999741b7dd2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:38.585687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a34f82332c946f3a5d16999741b7dd2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:38.593294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:12:38.593294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: warnings.warn(msg) Jun 17 15:12:38.593294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: Jun 17 15:12:38.594543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:38.637503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 816/1655] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:38.639397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45572111-e5c7-470e-9942-70aa33b9e247 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:38.639863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45572111-e5c7-470e-9942-70aa33b9e247 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:38.640323 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45572111-e5c7-470e-9942-70aa33b9e247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:38.690547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-45572111-e5c7-470e-9942-70aa33b9e247 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:38.694778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-45572111-e5c7-470e-9942-70aa33b9e247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:38.735893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 817/1656] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:38.737342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45572111-e5c7-470e-9942-70aa33b9e247 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:38.743060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-45572111-e5c7-470e-9942-70aa33b9e247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:38.791142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a34f82332c946f3a5d16999741b7dd2', 'request_id': 'req-84be568f-7f6c-4825-9643-d0ffba204808'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.826243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a34f82332c946f3a5d16999741b7dd2', 'request_id': 'req-84be568f-7f6c-4825-9643-d0ffba204808'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.845888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a34f82332c946f3a5d16999741b7dd2', 'request_id': 'req-84be568f-7f6c-4825-9643-d0ffba204808'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.876108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] The token cache is being invalidate because project 3a34f82332c946f3a5d16999741b7dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:12:38.878791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.881868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-84be568f-7f6c-4825-9643-d0ffba204808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:38.884125 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 840/1657] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:12:38 2022] DELETE /identity/v3/projects/3a34f82332c946f3a5d16999741b7dd2 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:38.894239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e815-159e-4b76-85a6-974ceeecfe83 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:38.895721 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e815-159e-4b76-85a6-974ceeecfe83 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:38.896082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e815-159e-4b76-85a6-974ceeecfe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:38.949643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2126e815-159e-4b76-85a6-974ceeecfe83 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:38.951262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2126e815-159e-4b76-85a6-974ceeecfe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:38.985011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45572111-e5c7-470e-9942-70aa33b9e247 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.086832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:39.136697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6982a-acbd-4bd4-a472-88e4f1b924a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.137679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6982a-acbd-4bd4-a472-88e4f1b924a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.138113 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6982a-acbd-4bd4-a472-88e4f1b924a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.138532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6982a-acbd-4bd4-a472-88e4f1b924a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.145324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-95e6982a-acbd-4bd4-a472-88e4f1b924a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:39.194830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 841/1658] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:39.198774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fb55b-c9ef-4e93-8ab6-ea564ca18e85 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.200035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fb55b-c9ef-4e93-8ab6-ea564ca18e85 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.201022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fb55b-c9ef-4e93-8ab6-ea564ca18e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.253060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-540fb55b-c9ef-4e93-8ab6-ea564ca18e85 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:39.255933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-540fb55b-c9ef-4e93-8ab6-ea564ca18e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:39.290653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 842/1659] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:39.296944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fb55b-c9ef-4e93-8ab6-ea564ca18e85 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:39.313092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6982a-acbd-4bd4-a472-88e4f1b924a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.315396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6982a-acbd-4bd4-a472-88e4f1b924a3 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.330024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fb55b-c9ef-4e93-8ab6-ea564ca18e85 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.332603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 818/1660] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:39.333982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b0371-b920-4de8-837a-ff3e7c283b26 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.334381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b0371-b920-4de8-837a-ff3e7c283b26 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.334668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b0371-b920-4de8-837a-ff3e7c283b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.344118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337f4e0-e831-47ea-9464-bf387a053976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.345354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f4e0-e831-47ea-9464-bf387a053976 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.345810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f4e0-e831-47ea-9464-bf387a053976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.346388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f4e0-e831-47ea-9464-bf387a053976 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.349967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337f4e0-e831-47ea-9464-bf387a053976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:39.350654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337f4e0-e831-47ea-9464-bf387a053976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.352442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337f4e0-e831-47ea-9464-bf387a053976 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.364096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b69b0371-b920-4de8-837a-ff3e7c283b26 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:39.365361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b69b0371-b920-4de8-837a-ff3e7c283b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:39.388898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 819/1661] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:39.390223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b0371-b920-4de8-837a-ff3e7c283b26 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:39.403288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 843/1662] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:39.406778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337f4e0-e831-47ea-9464-bf387a053976 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:39.411547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b0371-b920-4de8-837a-ff3e7c283b26 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.417159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa772b56-063f-447f-b1cb-2968ae4af10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.418450 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772b56-063f-447f-b1cb-2968ae4af10c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.418735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772b56-063f-447f-b1cb-2968ae4af10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.419011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772b56-063f-447f-b1cb-2968ae4af10c admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.419933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa772b56-063f-447f-b1cb-2968ae4af10c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:39.420246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa772b56-063f-447f-b1cb-2968ae4af10c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.422029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa772b56-063f-447f-b1cb-2968ae4af10c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.433192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:39.442291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337f4e0-e831-47ea-9464-bf387a053976 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.443270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 820/1663] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:39.450504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa772b56-063f-447f-b1cb-2968ae4af10c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:39.459879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9c9a4-402a-4531-8923-52879ad8ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.460849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9c9a4-402a-4531-8923-52879ad8ec29 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.461367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9c9a4-402a-4531-8923-52879ad8ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.461648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9c9a4-402a-4531-8923-52879ad8ec29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.462538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9c9a4-402a-4531-8923-52879ad8ec29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.471932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9c9a4-402a-4531-8923-52879ad8ec29 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.472148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa772b56-063f-447f-b1cb-2968ae4af10c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.477667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bce8d5-3b7c-4ad6-b2c9-685eaaa1ac05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.479512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bce8d5-3b7c-4ad6-b2c9-685eaaa1ac05 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.479924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bce8d5-3b7c-4ad6-b2c9-685eaaa1ac05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.480300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bce8d5-3b7c-4ad6-b2c9-685eaaa1ac05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.481242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bce8d5-3b7c-4ad6-b2c9-685eaaa1ac05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.483990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bce8d5-3b7c-4ad6-b2c9-685eaaa1ac05 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.526372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 821/1664] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:39 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:39.528049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bce8d5-3b7c-4ad6-b2c9-685eaaa1ac05 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:39.551763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 844/1665] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:39 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:39.567604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9c9a4-402a-4531-8923-52879ad8ec29 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:39.642682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bce8d5-3b7c-4ad6-b2c9-685eaaa1ac05 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.706628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:39.723545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a604b9-67e0-4f38-a6af-ff608032afff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.723545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a604b9-67e0-4f38-a6af-ff608032afff admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.723545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a604b9-67e0-4f38-a6af-ff608032afff admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.723545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a604b9-67e0-4f38-a6af-ff608032afff admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.724000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a604b9-67e0-4f38-a6af-ff608032afff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.725608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a604b9-67e0-4f38-a6af-ff608032afff admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.765563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 822/1666] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:39 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:39.769281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a604b9-67e0-4f38-a6af-ff608032afff admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:39.786118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9c9a4-402a-4531-8923-52879ad8ec29 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.786598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a604b9-67e0-4f38-a6af-ff608032afff admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.792390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bd5b8-4d54-4d2d-911a-965567c4f6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.793357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bd5b8-4d54-4d2d-911a-965567c4f6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.793821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bd5b8-4d54-4d2d-911a-965567c4f6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.794407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bd5b8-4d54-4d2d-911a-965567c4f6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.795354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bd5b8-4d54-4d2d-911a-965567c4f6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.797708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bd5b8-4d54-4d2d-911a-965567c4f6d6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.803714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90ba2f-e04e-4069-af25-a7ee90ff71b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.804439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90ba2f-e04e-4069-af25-a7ee90ff71b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.804721 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90ba2f-e04e-4069-af25-a7ee90ff71b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.805000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90ba2f-e04e-4069-af25-a7ee90ff71b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.805774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90ba2f-e04e-4069-af25-a7ee90ff71b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.807770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90ba2f-e04e-4069-af25-a7ee90ff71b7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.814026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 823/1667] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:39.815211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bd5b8-4d54-4d2d-911a-965567c4f6d6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:39.827535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bd5b8-4d54-4d2d-911a-965567c4f6d6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.834113 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d45e56-7abb-4c07-95f1-38651c76c32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.834948 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d45e56-7abb-4c07-95f1-38651c76c32f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.835298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d45e56-7abb-4c07-95f1-38651c76c32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.835665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d45e56-7abb-4c07-95f1-38651c76c32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.836635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d45e56-7abb-4c07-95f1-38651c76c32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.838708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d45e56-7abb-4c07-95f1-38651c76c32f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.855303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 824/1668] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:39.859810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d45e56-7abb-4c07-95f1-38651c76c32f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:39.877082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d45e56-7abb-4c07-95f1-38651c76c32f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.880626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 845/1669] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:39 2022] POST /identity/v3/users => generated 282 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:39.884517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90ba2f-e04e-4069-af25-a7ee90ff71b7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:39.894519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31de99-4073-47be-9ae8-6b09b7fef046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.895760 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31de99-4073-47be-9ae8-6b09b7fef046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.896043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31de99-4073-47be-9ae8-6b09b7fef046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.896320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31de99-4073-47be-9ae8-6b09b7fef046 admin admin] PATH_INFO: `/v3/projects/f1321eb6e860443495ee829a6d1ed1ed/users/c2aa833408cb40259622b0a027adf92e/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.916635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31de99-4073-47be-9ae8-6b09b7fef046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1321eb6e860443495ee829a6d1ed1ed, user_id=c2aa833408cb40259622b0a027adf92e, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.916848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90ba2f-e04e-4069-af25-a7ee90ff71b7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:39.920851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31de99-4073-47be-9ae8-6b09b7fef046 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.932959 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2dce-7c88-436b-908e-346d6ab734ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:39.934515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2dce-7c88-436b-908e-346d6ab734ec admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.934802 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2dce-7c88-436b-908e-346d6ab734ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.935082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2dce-7c88-436b-908e-346d6ab734ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.941676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a2dce-7c88-436b-908e-346d6ab734ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:39.945142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a2dce-7c88-436b-908e-346d6ab734ec admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:39.961440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 825/1670] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:39 2022] PUT /identity/v3/projects/f1321eb6e860443495ee829a6d1ed1ed/users/c2aa833408cb40259622b0a027adf92e/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:39.963115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9e7b-7e88-497c-b909-10afe42968dc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:39.963414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9e7b-7e88-497c-b909-10afe42968dc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:39.963803 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9e7b-7e88-497c-b909-10afe42968dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:39.998798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 846/1671] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:40.003583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2dce-7c88-436b-908e-346d6ab734ec admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:40.011828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-51cc9e7b-7e88-497c-b909-10afe42968dc None None] MFA Rules not processed for user `c2aa833408cb40259622b0a027adf92e`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:40.013377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-51cc9e7b-7e88-497c-b909-10afe42968dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:40.036771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2dce-7c88-436b-908e-346d6ab734ec admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:40.136506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 826/1672] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:40.145559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc9e7b-7e88-497c-b909-10afe42968dc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:40.146919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-51cc9e7b-7e88-497c-b909-10afe42968dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:40.238798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234b92-db08-43fc-bc29-48277da7324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:40.239666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234b92-db08-43fc-bc29-48277da7324f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:40.240119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234b92-db08-43fc-bc29-48277da7324f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:40.240452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234b92-db08-43fc-bc29-48277da7324f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:40.243350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23234b92-db08-43fc-bc29-48277da7324f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:40.246282 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23234b92-db08-43fc-bc29-48277da7324f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:40.280790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 847/1673] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:40.288519 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234b92-db08-43fc-bc29-48277da7324f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:40.316142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc9e7b-7e88-497c-b909-10afe42968dc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:40.316397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234b92-db08-43fc-bc29-48277da7324f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:40.325950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6ac66-f43e-4a64-b15e-0a62d1a8f654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:40.326638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6ac66-f43e-4a64-b15e-0a62d1a8f654 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:40.326920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6ac66-f43e-4a64-b15e-0a62d1a8f654 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:40.327293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6ac66-f43e-4a64-b15e-0a62d1a8f654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:40.327990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98949d4-67dd-44a6-84db-0e9331063cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:40.333001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98949d4-67dd-44a6-84db-0e9331063cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:40.333457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98949d4-67dd-44a6-84db-0e9331063cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:40.333845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98949d4-67dd-44a6-84db-0e9331063cb2 admin admin] PATH_INFO: `/v3/projects/aa105734912041de80575993a17083bf/users/13e2c40f03c147cbb60ae87cf3b488c9/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:40.351311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6ac66-f43e-4a64-b15e-0a62d1a8f654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:40.353003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6ac66-f43e-4a64-b15e-0a62d1a8f654 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:40.369301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98949d4-67dd-44a6-84db-0e9331063cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa105734912041de80575993a17083bf, user_id=13e2c40f03c147cbb60ae87cf3b488c9, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:40.376589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98949d4-67dd-44a6-84db-0e9331063cb2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:40.387837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 827/1674] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:12:40.411796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 848/1675] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:40 2022] PUT /identity/v3/projects/aa105734912041de80575993a17083bf/users/13e2c40f03c147cbb60ae87cf3b488c9/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:40.422228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e63c12-1895-46a9-bc4d-1625bfd70f66 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:40.423923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e63c12-1895-46a9-bc4d-1625bfd70f66 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:40.423923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e63c12-1895-46a9-bc4d-1625bfd70f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:40.458297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:40.482355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-27e63c12-1895-46a9-bc4d-1625bfd70f66 None None] MFA Rules not processed for user `13e2c40f03c147cbb60ae87cf3b488c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:40.483675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-27e63c12-1895-46a9-bc4d-1625bfd70f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:40.628482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 828/1676] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:40.634947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98949d4-67dd-44a6-84db-0e9331063cb2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:40.726307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:40.757701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e63c12-1895-46a9-bc4d-1625bfd70f66 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:40.759167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-27e63c12-1895-46a9-bc4d-1625bfd70f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:40.835067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98949d4-67dd-44a6-84db-0e9331063cb2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:40.850272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79353a01-bb00-498e-8ccf-2f544ed6b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:40.852264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79353a01-bb00-498e-8ccf-2f544ed6b752 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:40.852695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79353a01-bb00-498e-8ccf-2f544ed6b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:40.854509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79353a01-bb00-498e-8ccf-2f544ed6b752 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:40.855391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79353a01-bb00-498e-8ccf-2f544ed6b752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:40.861487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79353a01-bb00-498e-8ccf-2f544ed6b752 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:40.929370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 849/1677] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:40 2022] POST /identity/v3/projects => generated 365 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:40.930785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79353a01-bb00-498e-8ccf-2f544ed6b752 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:40.963444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e63c12-1895-46a9-bc4d-1625bfd70f66 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:41.132445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79353a01-bb00-498e-8ccf-2f544ed6b752 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:41.145449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:41.146852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:41.148895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:41.155088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] PATH_INFO: `/v3/users/c2aa833408cb40259622b0a027adf92e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:41.157809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2aa833408cb40259622b0a027adf92e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:41.162216 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:41.177425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:41.179008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:41.179008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:41.179008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] PATH_INFO: `/v3/projects/bccfb6d925284ea396f3f9774b37a373` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:41.187751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bccfb6d925284ea396f3f9774b37a373)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:41.187751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:41.304060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:41.310983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bccfb6d925284ea396f3f9774b37a373', 'request_id': 'req-66a13166-104c-482a-ab0d-2a2d117c5de2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.326149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bccfb6d925284ea396f3f9774b37a373', 'request_id': 'req-66a13166-104c-482a-ab0d-2a2d117c5de2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.348592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2aa833408cb40259622b0a027adf92e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.354632 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bccfb6d925284ea396f3f9774b37a373', 'request_id': 'req-66a13166-104c-482a-ab0d-2a2d117c5de2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.374491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] The token cache is being invalidate because project bccfb6d925284ea396f3f9774b37a373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:12:41.375051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.377393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2aa833408cb40259622b0a027adf92e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.377937 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.378857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2aa833408cb40259622b0a027adf92e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.380419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 829/1678] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:12:40 2022] DELETE /identity/v3/projects/bccfb6d925284ea396f3f9774b37a373 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:12:41.381463 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:41.384177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:41.409910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2aa833408cb40259622b0a027adf92e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.410981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2aa833408cb40259622b0a027adf92e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.452676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 850/1679] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:12:40 2022] DELETE /identity/v3/users/c2aa833408cb40259622b0a027adf92e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:41.454888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:41.461735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:41.524734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a13166-104c-482a-ab0d-2a2d117c5de2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:41.614210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:41.633460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e39b7-1145-4c74-b0ce-39dfb9a73414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:41.636041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e39b7-1145-4c74-b0ce-39dfb9a73414 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:41.637872 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e39b7-1145-4c74-b0ce-39dfb9a73414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:41.640257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e39b7-1145-4c74-b0ce-39dfb9a73414 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:41.641230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e39b7-1145-4c74-b0ce-39dfb9a73414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:41.646207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e39b7-1145-4c74-b0ce-39dfb9a73414 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:41.690669 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc8a19-49d3-4e47-bec0-4e83036bf07a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:41.700719 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:41.706717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:41.709701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:41.710928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] PATH_INFO: `/v3/users/294cceb9161e4004b0d582d33d8d9be7` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:41.714970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 830/1680] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:41 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:41.715869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=294cceb9161e4004b0d582d33d8d9be7)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:41.717850 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:41.719796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7810f-5b5d-4ecc-96bf-b91bba12d4c0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:41.720668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7810f-5b5d-4ecc-96bf-b91bba12d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:41.720668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7810f-5b5d-4ecc-96bf-b91bba12d4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:41.771186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e6e7810f-5b5d-4ecc-96bf-b91bba12d4c0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:41.772731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6e7810f-5b5d-4ecc-96bf-b91bba12d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:41.794741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 831/1681] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:41.796644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7810f-5b5d-4ecc-96bf-b91bba12d4c0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:41.798973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6e7810f-5b5d-4ecc-96bf-b91bba12d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:41.822177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7810f-5b5d-4ecc-96bf-b91bba12d4c0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:41.822687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294cceb9161e4004b0d582d33d8d9be7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.832995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb8694-dc11-4075-9221-1354716720b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:41.834122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb8694-dc11-4075-9221-1354716720b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:41.834554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb8694-dc11-4075-9221-1354716720b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:41.834995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb8694-dc11-4075-9221-1354716720b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:41.836333 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb8694-dc11-4075-9221-1354716720b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:41.839895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb8694-dc11-4075-9221-1354716720b0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:41.842686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294cceb9161e4004b0d582d33d8d9be7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.847390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294cceb9161e4004b0d582d33d8d9be7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.854279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 832/1682] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:41.855401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb8694-dc11-4075-9221-1354716720b0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:41.858610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-74bb8694-dc11-4075-9221-1354716720b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:41.869107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294cceb9161e4004b0d582d33d8d9be7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.870022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294cceb9161e4004b0d582d33d8d9be7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:41.915000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 851/1683] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:12:41 2022] DELETE /identity/v3/users/294cceb9161e4004b0d582d33d8d9be7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:41.916079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:41.917990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:42.007015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb8694-dc11-4075-9221-1354716720b0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:42.012397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:42.098793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f827b6-6501-4bdd-98a1-e1bd7e9efa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:42.099581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f827b6-6501-4bdd-98a1-e1bd7e9efa0b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:42.099953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f827b6-6501-4bdd-98a1-e1bd7e9efa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:42.100323 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f827b6-6501-4bdd-98a1-e1bd7e9efa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:42.102464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-09f827b6-6501-4bdd-98a1-e1bd7e9efa0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:42.163433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9085041-ee33-43c7-a817-f016467c3c99 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:42.188482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8693c-118e-4fd0-897d-ca5c119fb334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:42.189489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8693c-118e-4fd0-897d-ca5c119fb334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:42.189773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8693c-118e-4fd0-897d-ca5c119fb334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:42.193515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8693c-118e-4fd0-897d-ca5c119fb334 admin admin] PATH_INFO: `/v3/projects/ae4600a3c8c74467a841f93bd12ef3e7/users/04e8eb62cfe4417e9858e81815b349e7/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:42.266443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8693c-118e-4fd0-897d-ca5c119fb334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4600a3c8c74467a841f93bd12ef3e7, user_id=04e8eb62cfe4417e9858e81815b349e7, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:42.269235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8693c-118e-4fd0-897d-ca5c119fb334 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:42.295571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f827b6-6501-4bdd-98a1-e1bd7e9efa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:42.299424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f827b6-6501-4bdd-98a1-e1bd7e9efa0b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:42.304571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 852/1684] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:41 2022] PUT /identity/v3/projects/ae4600a3c8c74467a841f93bd12ef3e7/users/04e8eb62cfe4417e9858e81815b349e7/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:42.313136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8693c-118e-4fd0-897d-ca5c119fb334 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:42.331664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 833/1685] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:42.392433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:42.424497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8693c-118e-4fd0-897d-ca5c119fb334 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:42.430469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc8795-51f5-40e0-be36-1b042c792e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:42.431179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc8795-51f5-40e0-be36-1b042c792e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:42.431456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc8795-51f5-40e0-be36-1b042c792e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:42.431728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc8795-51f5-40e0-be36-1b042c792e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:42.432463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc8795-51f5-40e0-be36-1b042c792e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:42.434585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc8795-51f5-40e0-be36-1b042c792e8e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:42.469412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 853/1686] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:42.473113 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f827b6-6501-4bdd-98a1-e1bd7e9efa0b service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:42.485133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f827b6-6501-4bdd-98a1-e1bd7e9efa0b service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:42.492726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb6faf-ff4b-4c74-91a6-20c4e2926875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:42.494616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6faf-ff4b-4c74-91a6-20c4e2926875 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:42.495067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6faf-ff4b-4c74-91a6-20c4e2926875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:42.495442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6faf-ff4b-4c74-91a6-20c4e2926875 admin admin] PATH_INFO: `/v3/projects/ae4600a3c8c74467a841f93bd12ef3e7/users/04e8eb62cfe4417e9858e81815b349e7/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:42.498248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb6faf-ff4b-4c74-91a6-20c4e2926875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4600a3c8c74467a841f93bd12ef3e7, user_id=04e8eb62cfe4417e9858e81815b349e7, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:42.501538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb6faf-ff4b-4c74-91a6-20c4e2926875 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:42.525656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 834/1687] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:42 2022] PUT /identity/v3/projects/ae4600a3c8c74467a841f93bd12ef3e7/users/04e8eb62cfe4417e9858e81815b349e7/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:42.527474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6d3f9-526b-4fb6-a138-58e5c354bab4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:42.527824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6d3f9-526b-4fb6-a138-58e5c354bab4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:42.528104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6d3f9-526b-4fb6-a138-58e5c354bab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:42.588346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c8b6d3f9-526b-4fb6-a138-58e5c354bab4 None None] MFA Rules not processed for user `04e8eb62cfe4417e9858e81815b349e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:42.590081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c8b6d3f9-526b-4fb6-a138-58e5c354bab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:42.668647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb6faf-ff4b-4c74-91a6-20c4e2926875 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:42.670434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7fdb6faf-ff4b-4c74-91a6-20c4e2926875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:42.763444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 854/1688] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:42.773150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6d3f9-526b-4fb6-a138-58e5c354bab4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:42.774799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c8b6d3f9-526b-4fb6-a138-58e5c354bab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:42.818865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb6faf-ff4b-4c74-91a6-20c4e2926875 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:42.834838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:42.836152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:42.836689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:42.837102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] PATH_INFO: `/v3/users/92dea2c602d742e3891cdc1c91e0dc1b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:42.840360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92dea2c602d742e3891cdc1c91e0dc1b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:42.843081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:42.950299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6d3f9-526b-4fb6-a138-58e5c354bab4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:42.964687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82258f18-7e4a-422c-96cd-df5ac024830f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:42.965583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258f18-7e4a-422c-96cd-df5ac024830f service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:42.965990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258f18-7e4a-422c-96cd-df5ac024830f service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:42.966366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258f18-7e4a-422c-96cd-df5ac024830f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:42.982550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92dea2c602d742e3891cdc1c91e0dc1b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:42.984677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:42.993303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82258f18-7e4a-422c-96cd-df5ac024830f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:42.996957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82258f18-7e4a-422c-96cd-df5ac024830f service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:43.006616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92dea2c602d742e3891cdc1c91e0dc1b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:43.008224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92dea2c602d742e3891cdc1c91e0dc1b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:43.038882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92dea2c602d742e3891cdc1c91e0dc1b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:43.046682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 855/1689] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:12:43.087006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92dea2c602d742e3891cdc1c91e0dc1b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:43.117688 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 835/1690] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:12:42 2022] DELETE /identity/v3/users/92dea2c602d742e3891cdc1c91e0dc1b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:12:43.119520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504c4f-ee14-448b-afe4-b1fd7ba51800 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:43.119791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504c4f-ee14-448b-afe4-b1fd7ba51800 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:43.120051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504c4f-ee14-448b-afe4-b1fd7ba51800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:43.167748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-21504c4f-ee14-448b-afe4-b1fd7ba51800 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:43.170885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-21504c4f-ee14-448b-afe4-b1fd7ba51800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:43.217875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:43.219365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:43.376467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 856/1691] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:43.382727 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da555d5-ab90-49ce-8794-c02d89947d8c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:43.384254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da555d5-ab90-49ce-8794-c02d89947d8c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:43.386318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da555d5-ab90-49ce-8794-c02d89947d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:43.404054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:43.404542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82082125-6227-41f2-87d4-242339c14070 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:43.418173 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1732f9-086b-4d78-9869-6b4d278efcf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:43.418557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1732f9-086b-4d78-9869-6b4d278efcf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:43.423621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1732f9-086b-4d78-9869-6b4d278efcf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:43.424032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1732f9-086b-4d78-9869-6b4d278efcf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:43.431079 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ab1732f9-086b-4d78-9869-6b4d278efcf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:43.456253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9da555d5-ab90-49ce-8794-c02d89947d8c None None] MFA Rules not processed for user `d770c98d01ea4c9bb20b79dab4bfc0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:43.457794 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9da555d5-ab90-49ce-8794-c02d89947d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:43.622814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1732f9-086b-4d78-9869-6b4d278efcf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:43.624635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1732f9-086b-4d78-9869-6b4d278efcf5 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:43.641596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 857/1692] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:43.651258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da555d5-ab90-49ce-8794-c02d89947d8c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:43.654228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 836/1693] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:43 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:43.662216 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1732f9-086b-4d78-9869-6b4d278efcf5 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:43.663683 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ab1732f9-086b-4d78-9869-6b4d278efcf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:43.663791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9da555d5-ab90-49ce-8794-c02d89947d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:43.895170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1732f9-086b-4d78-9869-6b4d278efcf5 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:43.898381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da555d5-ab90-49ce-8794-c02d89947d8c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:43.913868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235f71e-5496-4738-a43b-42899523e68d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:43.914030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0f689-2be1-4cef-a943-38a417edf8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:43.914566 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235f71e-5496-4738-a43b-42899523e68d service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:43.914695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f689-2be1-4cef-a943-38a417edf8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:43.915055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f689-2be1-4cef-a943-38a417edf8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:43.915424 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f689-2be1-4cef-a943-38a417edf8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:43.923680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235f71e-5496-4738-a43b-42899523e68d service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:43.927008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235f71e-5496-4738-a43b-42899523e68d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:43.943999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0f689-2be1-4cef-a943-38a417edf8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:43.945724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0f689-2be1-4cef-a943-38a417edf8d0 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:43.952320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235f71e-5496-4738-a43b-42899523e68d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:43.957188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235f71e-5496-4738-a43b-42899523e68d service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:43.970469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 858/1694] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:43.976892 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0f689-2be1-4cef-a943-38a417edf8d0 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:43.984232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 837/1695] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:43.984561 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5ac0f689-2be1-4cef-a943-38a417edf8d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:44.013546 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0f689-2be1-4cef-a943-38a417edf8d0 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:44.024502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:44.025854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:44.026262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:44.026690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] PATH_INFO: `/v3/projects/f1321eb6e860443495ee829a6d1ed1ed` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:44.041916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1321eb6e860443495ee829a6d1ed1ed)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:44.043914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:44.240781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1321eb6e860443495ee829a6d1ed1ed', 'request_id': 'req-e2eb933c-7dd2-4498-8371-f081db8036c2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:44.256094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1321eb6e860443495ee829a6d1ed1ed', 'request_id': 'req-e2eb933c-7dd2-4498-8371-f081db8036c2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:44.277360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1321eb6e860443495ee829a6d1ed1ed', 'request_id': 'req-e2eb933c-7dd2-4498-8371-f081db8036c2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:44.306456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] The token cache is being invalidate because project f1321eb6e860443495ee829a6d1ed1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:12:44.307746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:44.308847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e2eb933c-7dd2-4498-8371-f081db8036c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:44.333452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 859/1696] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:12:43 2022] DELETE /identity/v3/projects/f1321eb6e860443495ee829a6d1ed1ed => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:44.335972 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20760a2-0445-4c3e-b6d8-a8899bf05f9d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:44.335972 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20760a2-0445-4c3e-b6d8-a8899bf05f9d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:44.335972 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20760a2-0445-4c3e-b6d8-a8899bf05f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:44.346758 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:44.390430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d20760a2-0445-4c3e-b6d8-a8899bf05f9d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:44.392039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d20760a2-0445-4c3e-b6d8-a8899bf05f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:44.538888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 838/1697] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:44.546877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df889c8-b358-4661-a6c3-eae62b4e24a3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:44.547642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df889c8-b358-4661-a6c3-eae62b4e24a3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:44.547642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df889c8-b358-4661-a6c3-eae62b4e24a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:44.588030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4df889c8-b358-4661-a6c3-eae62b4e24a3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:44.589467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4df889c8-b358-4661-a6c3-eae62b4e24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:44.610125 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 860/1698] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:44.611400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20760a2-0445-4c3e-b6d8-a8899bf05f9d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:44.628933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20760a2-0445-4c3e-b6d8-a8899bf05f9d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:44.645757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051da1c3-e86b-43ba-a191-0af9dcbb3548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:44.647399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051da1c3-e86b-43ba-a191-0af9dcbb3548 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:44.649693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051da1c3-e86b-43ba-a191-0af9dcbb3548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:44.651423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051da1c3-e86b-43ba-a191-0af9dcbb3548 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:44.652414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051da1c3-e86b-43ba-a191-0af9dcbb3548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:44.654263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051da1c3-e86b-43ba-a191-0af9dcbb3548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:44.662651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051da1c3-e86b-43ba-a191-0af9dcbb3548 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:44.688171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 839/1699] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:44.692660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df889c8-b358-4661-a6c3-eae62b4e24a3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:44.728112 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df889c8-b358-4661-a6c3-eae62b4e24a3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:44.731607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051da1c3-e86b-43ba-a191-0af9dcbb3548 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:44.735149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-051da1c3-e86b-43ba-a191-0af9dcbb3548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:44.748778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c515e8-53ea-46ae-bdfa-c1a3b83bf1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:44.749884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c515e8-53ea-46ae-bdfa-c1a3b83bf1ee admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:44.752171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c515e8-53ea-46ae-bdfa-c1a3b83bf1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:44.752494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c515e8-53ea-46ae-bdfa-c1a3b83bf1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:44.754908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051da1c3-e86b-43ba-a191-0af9dcbb3548 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:44.756661 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c515e8-53ea-46ae-bdfa-c1a3b83bf1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:44.762526 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:44.763708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:44.764540 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:44.765081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] PATH_INFO: `/v3/projects/1da449b7199141d8ac19e1694c507232` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:44.765486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c515e8-53ea-46ae-bdfa-c1a3b83bf1ee admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:44.767753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da449b7199141d8ac19e1694c507232)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:44.772134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:44.809687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:44.863378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 861/1700] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:44 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:44.864510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c515e8-53ea-46ae-bdfa-c1a3b83bf1ee admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:44.866268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da449b7199141d8ac19e1694c507232', 'request_id': 'req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:44.880352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da449b7199141d8ac19e1694c507232', 'request_id': 'req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:44.900217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da449b7199141d8ac19e1694c507232', 'request_id': 'req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:44.920757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] The token cache is being invalidate because project 1da449b7199141d8ac19e1694c507232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:12:44.921435 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:44.922208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc9b76b0-f10a-4f8c-b8a1-4327d5eec90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:44.924429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 840/1701] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:12:44 2022] DELETE /identity/v3/projects/1da449b7199141d8ac19e1694c507232 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:44.938267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4491cd-11fe-45f2-89e8-72f428871eb9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:44.940485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4491cd-11fe-45f2-89e8-72f428871eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:44.941168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4491cd-11fe-45f2-89e8-72f428871eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.002988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-da4491cd-11fe-45f2-89e8-72f428871eb9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:45.006093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-da4491cd-11fe-45f2-89e8-72f428871eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:45.027463 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 841/1702] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:45.035901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0d40-a556-4478-a8d4-5e6158d1a811 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.036303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0d40-a556-4478-a8d4-5e6158d1a811 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.036674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0d40-a556-4478-a8d4-5e6158d1a811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.038713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c515e8-53ea-46ae-bdfa-c1a3b83bf1ee admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:45.046799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396be77-bc49-4c93-adbe-7fc856c2c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:45.048152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396be77-bc49-4c93-adbe-7fc856c2c3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.048645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396be77-bc49-4c93-adbe-7fc856c2c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.049068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396be77-bc49-4c93-adbe-7fc856c2c3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.056398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396be77-bc49-4c93-adbe-7fc856c2c3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:45.059692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396be77-bc49-4c93-adbe-7fc856c2c3a2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:45.080508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c39f0d40-a556-4478-a8d4-5e6158d1a811 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:45.080508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c39f0d40-a556-4478-a8d4-5e6158d1a811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:45.102746 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 842/1703] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:12:45.107125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0d40-a556-4478-a8d4-5e6158d1a811 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:45.119130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 862/1704] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:44 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:12:45.125337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396be77-bc49-4c93-adbe-7fc856c2c3a2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:45.128338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d396be77-bc49-4c93-adbe-7fc856c2c3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:45.132316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0d40-a556-4478-a8d4-5e6158d1a811 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:45.142346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ea2b6-a23c-4dff-a6ae-41d9b055ea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:45.142944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ea2b6-a23c-4dff-a6ae-41d9b055ea62 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.143328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ea2b6-a23c-4dff-a6ae-41d9b055ea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.143610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ea2b6-a23c-4dff-a6ae-41d9b055ea62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.144522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ea2b6-a23c-4dff-a6ae-41d9b055ea62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:45.144957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ea2b6-a23c-4dff-a6ae-41d9b055ea62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:45.146935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ea2b6-a23c-4dff-a6ae-41d9b055ea62 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:45.163361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 843/1705] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:45.167727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ea2b6-a23c-4dff-a6ae-41d9b055ea62 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:45.167972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396be77-bc49-4c93-adbe-7fc856c2c3a2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:45.179578 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8d835-82ba-4705-b3b6-ee4c23daaf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:45.182951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d835-82ba-4705-b3b6-ee4c23daaf47 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.183297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d835-82ba-4705-b3b6-ee4c23daaf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.183581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d835-82ba-4705-b3b6-ee4c23daaf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.187076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8d835-82ba-4705-b3b6-ee4c23daaf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:45.188987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8d835-82ba-4705-b3b6-ee4c23daaf47 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:45.198044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ea2b6-a23c-4dff-a6ae-41d9b055ea62 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:45.218652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274eac2-a2e7-4e96-b862-7d5e1a11919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:45.221994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 863/1706] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:45.222948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8d835-82ba-4705-b3b6-ee4c23daaf47 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:45.228300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274eac2-a2e7-4e96-b862-7d5e1a11919f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.228877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98a8d835-82ba-4705-b3b6-ee4c23daaf47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:45.229605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274eac2-a2e7-4e96-b862-7d5e1a11919f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.229894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274eac2-a2e7-4e96-b862-7d5e1a11919f admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.234320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274eac2-a2e7-4e96-b862-7d5e1a11919f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:45.242097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274eac2-a2e7-4e96-b862-7d5e1a11919f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:45.286851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8d835-82ba-4705-b3b6-ee4c23daaf47 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:45.297243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:45.298599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.299156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.299723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] PATH_INFO: `/v3/projects/adf2747597b54241886457386924b42c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.301465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf2747597b54241886457386924b42c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:45.301573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 844/1707] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:45 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:45.304471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:45.306909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274eac2-a2e7-4e96-b862-7d5e1a11919f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:45.425551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:45.473470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf2747597b54241886457386924b42c', 'request_id': 'req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:45.501418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf2747597b54241886457386924b42c', 'request_id': 'req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:45.516857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274eac2-a2e7-4e96-b862-7d5e1a11919f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:45.532979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf2747597b54241886457386924b42c', 'request_id': 'req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:45.583543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] The token cache is being invalidate because project adf2747597b54241886457386924b42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:12:45.600415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:45.606593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:45.610001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 864/1708] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:12:45 2022] DELETE /identity/v3/projects/adf2747597b54241886457386924b42c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:45.620485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:45.629138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:45.665426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ff019-b86a-4066-91b6-33b02af04d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:45.666790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff019-b86a-4066-91b6-33b02af04d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.667223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff019-b86a-4066-91b6-33b02af04d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.667635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff019-b86a-4066-91b6-33b02af04d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.668701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ff019-b86a-4066-91b6-33b02af04d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:45.671302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ff019-b86a-4066-91b6-33b02af04d59 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:45.687102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 845/1709] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:45.688771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb503b-7acc-4fe8-8ba3-204575e4a713 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.689252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb503b-7acc-4fe8-8ba3-204575e4a713 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.689657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb503b-7acc-4fe8-8ba3-204575e4a713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.736451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a4bb503b-7acc-4fe8-8ba3-204575e4a713 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:45.744404 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a4bb503b-7acc-4fe8-8ba3-204575e4a713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:45.759716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 846/1710] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:45.761020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb503b-7acc-4fe8-8ba3-204575e4a713 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:45.768458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a4bb503b-7acc-4fe8-8ba3-204575e4a713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:45.806519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb503b-7acc-4fe8-8ba3-204575e4a713 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:45.822017 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f47b9-46db-47b0-bc56-bbc0b38e8b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:45.824680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f47b9-46db-47b0-bc56-bbc0b38e8b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.825001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f47b9-46db-47b0-bc56-bbc0b38e8b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.825335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f47b9-46db-47b0-bc56-bbc0b38e8b0f admin admin] PATH_INFO: `/v3/projects/7d4ffe1a58e44bafb1a54de3e5c84cee/users/f890c880d5044e90ac5f3d97815a7388/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.832897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:45.860912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6944123-2795-4a8f-a5fb-3f8b95cb3bb0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:45.868828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f47b9-46db-47b0-bc56-bbc0b38e8b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4ffe1a58e44bafb1a54de3e5c84cee, user_id=f890c880d5044e90ac5f3d97815a7388, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:45.871422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723057d1-0b9b-4314-ace7-cbfd38c90430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:45.872155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f47b9-46db-47b0-bc56-bbc0b38e8b0f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:45.874613 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723057d1-0b9b-4314-ace7-cbfd38c90430 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.874908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723057d1-0b9b-4314-ace7-cbfd38c90430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.875399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723057d1-0b9b-4314-ace7-cbfd38c90430 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.876252 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723057d1-0b9b-4314-ace7-cbfd38c90430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:45.878413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723057d1-0b9b-4314-ace7-cbfd38c90430 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:45.903899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 847/1711] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:45 2022] PUT /identity/v3/projects/7d4ffe1a58e44bafb1a54de3e5c84cee/users/f890c880d5044e90ac5f3d97815a7388/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:45.905344 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ab96-dfc5-4076-86ce-ebaec969dc62 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.905638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ab96-dfc5-4076-86ce-ebaec969dc62 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.906206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ab96-dfc5-4076-86ce-ebaec969dc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:45.951524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ff21ab96-dfc5-4076-86ce-ebaec969dc62 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:45.974413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ff21ab96-dfc5-4076-86ce-ebaec969dc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:45.983139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 865/1712] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:45 2022] POST /identity/v3/users => generated 290 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:45.989570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897913-67a1-4e83-bd0e-3252b13d1c9b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:45.991140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897913-67a1-4e83-bd0e-3252b13d1c9b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:45.991941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897913-67a1-4e83-bd0e-3252b13d1c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:46.094486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6c897913-67a1-4e83-bd0e-3252b13d1c9b None None] MFA Rules not processed for user `f890c880d5044e90ac5f3d97815a7388`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:46.097863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6c897913-67a1-4e83-bd0e-3252b13d1c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:46.259162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 848/1713] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:46.271160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f34d-008e-4978-af26-88a3f68e5570 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:46.271790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f34d-008e-4978-af26-88a3f68e5570 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:46.272085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f34d-008e-4978-af26-88a3f68e5570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:46.399654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a988f34d-008e-4978-af26-88a3f68e5570 None None] MFA Rules not processed for user `0a6708681b7549fcba86b5a7f3d0d0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:46.400917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a988f34d-008e-4978-af26-88a3f68e5570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:46.442436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 866/1714] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:46.444691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c897913-67a1-4e83-bd0e-3252b13d1c9b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:46.479545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c897913-67a1-4e83-bd0e-3252b13d1c9b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:46.498040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be05fa5-63d4-44da-8cd9-ca5896b02d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:46.500444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be05fa5-63d4-44da-8cd9-ca5896b02d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:46.500781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be05fa5-63d4-44da-8cd9-ca5896b02d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:46.501096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be05fa5-63d4-44da-8cd9-ca5896b02d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:46.502020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be05fa5-63d4-44da-8cd9-ca5896b02d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:46.505985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be05fa5-63d4-44da-8cd9-ca5896b02d31 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:46.537261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:46.538974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 867/1715] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:46.541121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be05fa5-63d4-44da-8cd9-ca5896b02d31 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:46.567080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be05fa5-63d4-44da-8cd9-ca5896b02d31 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:46.595817 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2bf0-8ada-48d5-b0e2-8f4df69ad482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:46.598567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2bf0-8ada-48d5-b0e2-8f4df69ad482 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:46.601239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2bf0-8ada-48d5-b0e2-8f4df69ad482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:46.601734 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2bf0-8ada-48d5-b0e2-8f4df69ad482 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:46.603587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2bf0-8ada-48d5-b0e2-8f4df69ad482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:46.604649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2bf0-8ada-48d5-b0e2-8f4df69ad482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:46.609724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2bf0-8ada-48d5-b0e2-8f4df69ad482 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:46.638994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 868/1716] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:46.643758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2bf0-8ada-48d5-b0e2-8f4df69ad482 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:46.659364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2bf0-8ada-48d5-b0e2-8f4df69ad482 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:46.667603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5453f-b0ef-4db6-a9fa-0f040e3103ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:46.668875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5453f-b0ef-4db6-a9fa-0f040e3103ca admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:46.670009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5453f-b0ef-4db6-a9fa-0f040e3103ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:46.670302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5453f-b0ef-4db6-a9fa-0f040e3103ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:46.671393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5453f-b0ef-4db6-a9fa-0f040e3103ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:46.673639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 849/1717] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:46.674520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988f34d-008e-4978-af26-88a3f68e5570 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:46.686316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5453f-b0ef-4db6-a9fa-0f040e3103ca admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:46.706720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988f34d-008e-4978-af26-88a3f68e5570 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:46.733768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 869/1718] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:46 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:46.734834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5453f-b0ef-4db6-a9fa-0f040e3103ca admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:46.741497 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ed036-ee1c-4d9b-b942-28aa2f964343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:46.742261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ed036-ee1c-4d9b-b942-28aa2f964343 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:46.742546 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ed036-ee1c-4d9b-b942-28aa2f964343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:46.742821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ed036-ee1c-4d9b-b942-28aa2f964343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:46.743611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ed036-ee1c-4d9b-b942-28aa2f964343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:46.745553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ed036-ee1c-4d9b-b942-28aa2f964343 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:46.792567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 850/1719] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:46.800118 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf77b6b-6dc0-4d4d-b6b7-06069085e587 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:46.800406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf77b6b-6dc0-4d4d-b6b7-06069085e587 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:46.800689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf77b6b-6dc0-4d4d-b6b7-06069085e587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:46.866647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0bf77b6b-6dc0-4d4d-b6b7-06069085e587 None None] MFA Rules not processed for user `0a6708681b7549fcba86b5a7f3d0d0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:46.867883 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0bf77b6b-6dc0-4d4d-b6b7-06069085e587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:46.883946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5453f-b0ef-4db6-a9fa-0f040e3103ca admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:46.897392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffb0e8-2500-444c-9fe5-ee8e86573824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:46.898096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffb0e8-2500-444c-9fe5-ee8e86573824 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:46.898376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffb0e8-2500-444c-9fe5-ee8e86573824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:46.899330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffb0e8-2500-444c-9fe5-ee8e86573824 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:46.899592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffb0e8-2500-444c-9fe5-ee8e86573824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:46.901557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffb0e8-2500-444c-9fe5-ee8e86573824 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:46.990173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 870/1720] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:46 2022] POST /identity/v3/projects => generated 369 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:46.991236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffb0e8-2500-444c-9fe5-ee8e86573824 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:47.039574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:47.074782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 851/1721] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:47.074782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf77b6b-6dc0-4d4d-b6b7-06069085e587 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:47.104885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf77b6b-6dc0-4d4d-b6b7-06069085e587 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:47.187384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffb0e8-2500-444c-9fe5-ee8e86573824 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:47.207115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce85c21-2ffd-4bfb-afd2-c4c81775b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:47.207827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce85c21-2ffd-4bfb-afd2-c4c81775b429 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:47.208108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce85c21-2ffd-4bfb-afd2-c4c81775b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:47.208385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce85c21-2ffd-4bfb-afd2-c4c81775b429 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:47.209095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce85c21-2ffd-4bfb-afd2-c4c81775b429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:47.211086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce85c21-2ffd-4bfb-afd2-c4c81775b429 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:47.235387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2432ed-83b0-4634-8617-fd74bb7598bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:47.236633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2432ed-83b0-4634-8617-fd74bb7598bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:47.237065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2432ed-83b0-4634-8617-fd74bb7598bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:47.237524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2432ed-83b0-4634-8617-fd74bb7598bf admin admin] PATH_INFO: `/v3/projects/a4a50e2497854643a7c1364d07983481/users/87bc08bf69114454ac1df066ed06228a/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:47.266449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 871/1722] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:46 2022] POST /identity/v3/users => generated 292 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:47.267418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce85c21-2ffd-4bfb-afd2-c4c81775b429 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:47.295408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2432ed-83b0-4634-8617-fd74bb7598bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a50e2497854643a7c1364d07983481, user_id=87bc08bf69114454ac1df066ed06228a, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:47.299415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce85c21-2ffd-4bfb-afd2-c4c81775b429 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:47.301692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2432ed-83b0-4634-8617-fd74bb7598bf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:47.321483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3912a2-ceac-4ba2-a1c9-51a720ac565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:47.322995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3912a2-ceac-4ba2-a1c9-51a720ac565a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:47.322995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3912a2-ceac-4ba2-a1c9-51a720ac565a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:47.323692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3912a2-ceac-4ba2-a1c9-51a720ac565a admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:47.324219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3912a2-ceac-4ba2-a1c9-51a720ac565a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:47.329808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3912a2-ceac-4ba2-a1c9-51a720ac565a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:47.400045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 872/1723] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:47 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:47.403687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3912a2-ceac-4ba2-a1c9-51a720ac565a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:47.415378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 852/1724] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:47 2022] PUT /identity/v3/projects/a4a50e2497854643a7c1364d07983481/users/87bc08bf69114454ac1df066ed06228a/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:47.415378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2432ed-83b0-4634-8617-fd74bb7598bf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:47.415665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fe3912a2-ceac-4ba2-a1c9-51a720ac565a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:47.549869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:47.604239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2432ed-83b0-4634-8617-fd74bb7598bf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:47.635156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac3661-6fcf-46fe-98c8-c23b041603aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:47.635804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac3661-6fcf-46fe-98c8-c23b041603aa admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:47.636085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac3661-6fcf-46fe-98c8-c23b041603aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:47.636356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac3661-6fcf-46fe-98c8-c23b041603aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:47.637127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac3661-6fcf-46fe-98c8-c23b041603aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:47.638827 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac3661-6fcf-46fe-98c8-c23b041603aa admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:47.661920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3912a2-ceac-4ba2-a1c9-51a720ac565a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:47.677886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 853/1725] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:47.678766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac3661-6fcf-46fe-98c8-c23b041603aa admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:47.741865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac3661-6fcf-46fe-98c8-c23b041603aa admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:47.767351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e5ff2-ecfa-4b51-b330-efed738ada54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:47.769197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e5ff2-ecfa-4b51-b330-efed738ada54 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:47.769455 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e5ff2-ecfa-4b51-b330-efed738ada54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:47.769723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e5ff2-ecfa-4b51-b330-efed738ada54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:47.770524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e5ff2-ecfa-4b51-b330-efed738ada54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:47.772274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e5ff2-ecfa-4b51-b330-efed738ada54 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:47.810743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 854/1726] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:47.812113 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38de9cb-9a50-4257-a59c-a7b5081b637c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:47.812399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38de9cb-9a50-4257-a59c-a7b5081b637c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:47.812679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38de9cb-9a50-4257-a59c-a7b5081b637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:47.829516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e7953-5210-425b-bfae-fb0fe894a186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:47.840083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e7953-5210-425b-bfae-fb0fe894a186 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:47.849566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e7953-5210-425b-bfae-fb0fe894a186 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:47.855501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e7953-5210-425b-bfae-fb0fe894a186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:47.881480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b38de9cb-9a50-4257-a59c-a7b5081b637c None None] MFA Rules not processed for user `87bc08bf69114454ac1df066ed06228a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:47.883117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b38de9cb-9a50-4257-a59c-a7b5081b637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:47.910696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:48.010629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e7953-5210-425b-bfae-fb0fe894a186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:48.012253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e7953-5210-425b-bfae-fb0fe894a186 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:48.036929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 873/1727] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:48.038402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ec4bb-4792-411b-a780-084d3f399a18 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:48.038691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ec4bb-4792-411b-a780-084d3f399a18 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:48.038969 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ec4bb-4792-411b-a780-084d3f399a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:48.039213 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 855/1728] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:48.042889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38de9cb-9a50-4257-a59c-a7b5081b637c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:48.061036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38de9cb-9a50-4257-a59c-a7b5081b637c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:48.076335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eb389-da34-49f0-9a68-466177d0a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:48.077147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eb389-da34-49f0-9a68-466177d0a5af admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:48.077335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eb389-da34-49f0-9a68-466177d0a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:48.077613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eb389-da34-49f0-9a68-466177d0a5af admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:48.078702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92eb389-da34-49f0-9a68-466177d0a5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:48.080457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92eb389-da34-49f0-9a68-466177d0a5af admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:48.100682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-177ec4bb-4792-411b-a780-084d3f399a18 None None] MFA Rules not processed for user `e54c15b29a374bc986040462451db2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:48.102178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-177ec4bb-4792-411b-a780-084d3f399a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:48.107419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 856/1729] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:48.107419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eb389-da34-49f0-9a68-466177d0a5af admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:48.128485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eb389-da34-49f0-9a68-466177d0a5af admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:48.140030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7677bfd-8907-452a-9fa0-06f734938aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:48.140777 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7677bfd-8907-452a-9fa0-06f734938aff admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:48.141037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7677bfd-8907-452a-9fa0-06f734938aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:48.141345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7677bfd-8907-452a-9fa0-06f734938aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:48.142194 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7677bfd-8907-452a-9fa0-06f734938aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:48.143887 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7677bfd-8907-452a-9fa0-06f734938aff admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:48.163691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 857/1730] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:48.163691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd555e8-9e34-4467-b422-b49659862227 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:48.163691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd555e8-9e34-4467-b422-b49659862227 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:48.164130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd555e8-9e34-4467-b422-b49659862227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:48.232224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dfd555e8-9e34-4467-b422-b49659862227 None None] MFA Rules not processed for user `81f7520d68b3473cbba90d8581afbfac`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:48.237929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dfd555e8-9e34-4467-b422-b49659862227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:48.251944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 874/1731] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:48.267378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ec4bb-4792-411b-a780-084d3f399a18 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:48.289667 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ec4bb-4792-411b-a780-084d3f399a18 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:48.301938 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650750e3-18fb-4026-bd78-06774c26c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:48.302619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650750e3-18fb-4026-bd78-06774c26c6de admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:48.302895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650750e3-18fb-4026-bd78-06774c26c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:48.303178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650750e3-18fb-4026-bd78-06774c26c6de admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:48.304038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650750e3-18fb-4026-bd78-06774c26c6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:48.306458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650750e3-18fb-4026-bd78-06774c26c6de admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:48.380496 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 875/1732] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:48 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:48.381478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650750e3-18fb-4026-bd78-06774c26c6de admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:48.417676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 858/1733] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:48.418860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd555e8-9e34-4467-b422-b49659862227 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:48.447639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd555e8-9e34-4467-b422-b49659862227 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:48.522689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:48.563267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650750e3-18fb-4026-bd78-06774c26c6de admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:48.574834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc38975-e732-4efe-acd3-dc680b637eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:48.576012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc38975-e732-4efe-acd3-dc680b637eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:48.576364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc38975-e732-4efe-acd3-dc680b637eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:48.576716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc38975-e732-4efe-acd3-dc680b637eb2 admin admin] PATH_INFO: `/v3/projects/084d897600d54984b67ade3a9d9bce3a/users/d861b7b4e17d4304bb89e86a9e5911db/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:48.611537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc38975-e732-4efe-acd3-dc680b637eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084d897600d54984b67ade3a9d9bce3a, user_id=d861b7b4e17d4304bb89e86a9e5911db, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:48.614502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc38975-e732-4efe-acd3-dc680b637eb2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:48.631056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351026c6-7740-4c8f-9188-b5a1da3a89ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:48.633500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351026c6-7740-4c8f-9188-b5a1da3a89ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:48.634498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351026c6-7740-4c8f-9188-b5a1da3a89ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:48.634614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351026c6-7740-4c8f-9188-b5a1da3a89ed admin admin] PATH_INFO: `/v3/projects/47e412c6d89b4cedb398a7b65e53adb4/users/c9d38b8da5d24712b223080b7f869ca1/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:48.643933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 876/1734] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:48 2022] PUT /identity/v3/projects/084d897600d54984b67ade3a9d9bce3a/users/d861b7b4e17d4304bb89e86a9e5911db/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:48.644128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470f4e6-3129-4729-97c9-3fbfd45bfa53 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:48.644388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470f4e6-3129-4729-97c9-3fbfd45bfa53 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:48.644654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470f4e6-3129-4729-97c9-3fbfd45bfa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:48.680765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d470f4e6-3129-4729-97c9-3fbfd45bfa53 None None] MFA Rules not processed for user `e54c15b29a374bc986040462451db2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:48.685767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351026c6-7740-4c8f-9188-b5a1da3a89ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e412c6d89b4cedb398a7b65e53adb4, user_id=c9d38b8da5d24712b223080b7f869ca1, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:48.690118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d470f4e6-3129-4729-97c9-3fbfd45bfa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:48.691759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351026c6-7740-4c8f-9188-b5a1da3a89ed admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:48.704369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:48.734396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 859/1735] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:48 2022] PUT /identity/v3/projects/47e412c6d89b4cedb398a7b65e53adb4/users/c9d38b8da5d24712b223080b7f869ca1/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:48.734396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351026c6-7740-4c8f-9188-b5a1da3a89ed admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:48.795324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 877/1736] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:48.796516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470f4e6-3129-4729-97c9-3fbfd45bfa53 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:48.798356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d470f4e6-3129-4729-97c9-3fbfd45bfa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:48.884508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470f4e6-3129-4729-97c9-3fbfd45bfa53 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:48.934354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351026c6-7740-4c8f-9188-b5a1da3a89ed admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:48.949947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fe740-a02b-46c8-8be5-80899e520c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:48.950880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe740-a02b-46c8-8be5-80899e520c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:48.951317 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe740-a02b-46c8-8be5-80899e520c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:48.951732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe740-a02b-46c8-8be5-80899e520c7d admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:48.952704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fe740-a02b-46c8-8be5-80899e520c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:48.955274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fe740-a02b-46c8-8be5-80899e520c7d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:48.968242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798cc43-bd4e-4ea1-ac68-40b934a1e8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:48.968242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798cc43-bd4e-4ea1-ac68-40b934a1e8e9 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:48.968242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798cc43-bd4e-4ea1-ac68-40b934a1e8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:48.968242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798cc43-bd4e-4ea1-ac68-40b934a1e8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.010912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 860/1737] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:48 2022] POST /identity/v3/users => generated 296 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:49.010912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c29362-8f8d-401b-8fce-84388f16c480 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.010912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c29362-8f8d-401b-8fce-84388f16c480 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.010912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c29362-8f8d-401b-8fce-84388f16c480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.037855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:49.050282 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798cc43-bd4e-4ea1-ac68-40b934a1e8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:49.052970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798cc43-bd4e-4ea1-ac68-40b934a1e8e9 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:49.064545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 878/1738] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:49.066728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c640b-f521-4d65-a758-ba8905a1e9cf None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.066728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c640b-f521-4d65-a758-ba8905a1e9cf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.066949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c640b-f521-4d65-a758-ba8905a1e9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.096132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c8c29362-8f8d-401b-8fce-84388f16c480 None None] MFA Rules not processed for user `d861b7b4e17d4304bb89e86a9e5911db`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:49.097385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c8c29362-8f8d-401b-8fce-84388f16c480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:49.107742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-246c640b-f521-4d65-a758-ba8905a1e9cf None None] MFA Rules not processed for user `c9d38b8da5d24712b223080b7f869ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:49.109455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-246c640b-f521-4d65-a758-ba8905a1e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:49.233537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 861/1739] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:49.234482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c29362-8f8d-401b-8fce-84388f16c480 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:49.244397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 879/1740] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:49.250557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af122c-5e2a-4214-b3d1-f53dfd4dd4e5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.251105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af122c-5e2a-4214-b3d1-f53dfd4dd4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.251516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af122c-5e2a-4214-b3d1-f53dfd4dd4e5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.253673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 880/1741] 10.222.0.45 () {54 vars in 912 bytes} [Fri Jun 17 15:12:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:12:49.254692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af122c-5e2a-4214-b3d1-f53dfd4dd4e5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:49.259059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c29362-8f8d-401b-8fce-84388f16c480 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:49.270425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e92f4-c902-4363-b0de-897ba8ca7e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:49.272723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e92f4-c902-4363-b0de-897ba8ca7e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.273022 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e92f4-c902-4363-b0de-897ba8ca7e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.273326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e92f4-c902-4363-b0de-897ba8ca7e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.275368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e92f4-c902-4363-b0de-897ba8ca7e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:49.276261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af122c-5e2a-4214-b3d1-f53dfd4dd4e5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:49.279618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e92f4-c902-4363-b0de-897ba8ca7e5e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:49.286763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da872b8-28b3-41d3-9dee-acf0448183bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:49.287741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da872b8-28b3-41d3-9dee-acf0448183bf service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.288133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da872b8-28b3-41d3-9dee-acf0448183bf service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.288518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da872b8-28b3-41d3-9dee-acf0448183bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.305763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 862/1742] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:49.307993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e92f4-c902-4363-b0de-897ba8ca7e5e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:49.331363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e92f4-c902-4363-b0de-897ba8ca7e5e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:49.344491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afbc5c-ee7d-4667-a173-d7f6a44f075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:49.346503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbc5c-ee7d-4667-a173-d7f6a44f075d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.346923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbc5c-ee7d-4667-a173-d7f6a44f075d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.347239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbc5c-ee7d-4667-a173-d7f6a44f075d admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.349239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afbc5c-ee7d-4667-a173-d7f6a44f075d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:49.354039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afbc5c-ee7d-4667-a173-d7f6a44f075d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:49.421958 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:49.440561 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 863/1743] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:49 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:49.440773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da872b8-28b3-41d3-9dee-acf0448183bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:49.441063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afbc5c-ee7d-4667-a173-d7f6a44f075d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:49.441156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da872b8-28b3-41d3-9dee-acf0448183bf service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:49.467321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 881/1744] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:49.472170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba67d-50d7-4911-96f7-959ca5436e1a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.473897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba67d-50d7-4911-96f7-959ca5436e1a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.475749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba67d-50d7-4911-96f7-959ca5436e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.574918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fedba67d-50d7-4911-96f7-959ca5436e1a None None] MFA Rules not processed for user `20745118f9eb436096a323ba2d22e94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:49.577473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fedba67d-50d7-4911-96f7-959ca5436e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:49.587825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afbc5c-ee7d-4667-a173-d7f6a44f075d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:49.593718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbbaf9-44d2-430d-8963-c7669655160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:49.594388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbbaf9-44d2-430d-8963-c7669655160e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.594765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbbaf9-44d2-430d-8963-c7669655160e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.594995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbbaf9-44d2-430d-8963-c7669655160e admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.595682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbbaf9-44d2-430d-8963-c7669655160e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:49.597637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbbaf9-44d2-430d-8963-c7669655160e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:49.630051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 864/1745] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:49 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:49.631142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbbaf9-44d2-430d-8963-c7669655160e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:49.714419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 882/1746] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:12:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:49.715732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8425e-1cff-49a8-8054-09e9be7c9b6c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.715972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8425e-1cff-49a8-8054-09e9be7c9b6c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.716280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8425e-1cff-49a8-8054-09e9be7c9b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.751888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6bb8425e-1cff-49a8-8054-09e9be7c9b6c None None] MFA Rules not processed for user `d770c98d01ea4c9bb20b79dab4bfc0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:49.753446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6bb8425e-1cff-49a8-8054-09e9be7c9b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:49.770561 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:49.771906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbbaf9-44d2-430d-8963-c7669655160e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:49.807449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cdab7-f45c-4dd3-bf5c-c4d083a9be9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:49.809324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cdab7-f45c-4dd3-bf5c-c4d083a9be9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.809965 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cdab7-f45c-4dd3-bf5c-c4d083a9be9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.810449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cdab7-f45c-4dd3-bf5c-c4d083a9be9f admin admin] PATH_INFO: `/v3/projects/4bd3e45290f54334ae3d42fcfa8dd19d/users/d5a2807237764867afb478efe10253db/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.840685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 883/1747] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:49.841732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8425e-1cff-49a8-8054-09e9be7c9b6c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:49.843272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cdab7-f45c-4dd3-bf5c-c4d083a9be9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd3e45290f54334ae3d42fcfa8dd19d, user_id=d5a2807237764867afb478efe10253db, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:49.848411 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cdab7-f45c-4dd3-bf5c-c4d083a9be9f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:49.859354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8425e-1cff-49a8-8054-09e9be7c9b6c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:49.867229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c31260-81f8-45e5-a9c8-a81108f19c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:49.868240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c31260-81f8-45e5-a9c8-a81108f19c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:49.869936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c31260-81f8-45e5-a9c8-a81108f19c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:49.870367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c31260-81f8-45e5-a9c8-a81108f19c00 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:49.871366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c31260-81f8-45e5-a9c8-a81108f19c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:49.873678 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c31260-81f8-45e5-a9c8-a81108f19c00 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:49.898394 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 865/1748] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:49 2022] PUT /identity/v3/projects/4bd3e45290f54334ae3d42fcfa8dd19d/users/d5a2807237764867afb478efe10253db/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:49.901435 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cdab7-f45c-4dd3-bf5c-c4d083a9be9f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:49.911554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 884/1749] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:49 2022] POST /identity/v3/users => generated 299 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:49.911554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c31260-81f8-45e5-a9c8-a81108f19c00 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:49.912404 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-82c31260-81f8-45e5-a9c8-a81108f19c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:50.026249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c31260-81f8-45e5-a9c8-a81108f19c00 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.084090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cdab7-f45c-4dd3-bf5c-c4d083a9be9f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.096488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f391d-1a22-4c88-8af0-825d3c29d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.097584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f391d-1a22-4c88-8af0-825d3c29d187 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.097866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f391d-1a22-4c88-8af0-825d3c29d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.098138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f391d-1a22-4c88-8af0-825d3c29d187 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.100017 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f391d-1a22-4c88-8af0-825d3c29d187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:50.106852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f391d-1a22-4c88-8af0-825d3c29d187 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:50.136775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:50.137743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5190c5-edb6-4459-a1f4-b935844c80e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.138472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5190c5-edb6-4459-a1f4-b935844c80e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.138749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5190c5-edb6-4459-a1f4-b935844c80e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.139029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5190c5-edb6-4459-a1f4-b935844c80e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.158393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5190c5-edb6-4459-a1f4-b935844c80e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:50.158728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 866/1750] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:49 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:50.158728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f391d-1a22-4c88-8af0-825d3c29d187 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:50.158888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5190c5-edb6-4459-a1f4-b935844c80e1 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:50.186694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f391d-1a22-4c88-8af0-825d3c29d187 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.187923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 885/1751] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:50.188893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5190c5-edb6-4459-a1f4-b935844c80e1 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:50.198193 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb89f5-2f41-4f94-bfad-258323a5e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.199081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb89f5-2f41-4f94-bfad-258323a5e925 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.199392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb89f5-2f41-4f94-bfad-258323a5e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.199829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb89f5-2f41-4f94-bfad-258323a5e925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.200772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb89f5-2f41-4f94-bfad-258323a5e925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:50.202663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb89f5-2f41-4f94-bfad-258323a5e925 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:50.226572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5190c5-edb6-4459-a1f4-b935844c80e1 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.227483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 867/1752] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:50.230299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb89f5-2f41-4f94-bfad-258323a5e925 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:50.254102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e0c6a-8d48-4628-a2a2-a56ceae16f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.254805 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e0c6a-8d48-4628-a2a2-a56ceae16f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.255083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e0c6a-8d48-4628-a2a2-a56ceae16f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.255357 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e0c6a-8d48-4628-a2a2-a56ceae16f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.257422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e0c6a-8d48-4628-a2a2-a56ceae16f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:50.259122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e0c6a-8d48-4628-a2a2-a56ceae16f7e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:50.262944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb89f5-2f41-4f94-bfad-258323a5e925 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.280914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fcc34-bde6-459f-9d6c-71b91d3a402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.281764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fcc34-bde6-459f-9d6c-71b91d3a402f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.282057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fcc34-bde6-459f-9d6c-71b91d3a402f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.282381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fcc34-bde6-459f-9d6c-71b91d3a402f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.283195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fcc34-bde6-459f-9d6c-71b91d3a402f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:50.284886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fcc34-bde6-459f-9d6c-71b91d3a402f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:50.298756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 886/1753] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:50.300061 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7065-2cc8-4ede-93d4-2e2383627e92 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.300475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7065-2cc8-4ede-93d4-2e2383627e92 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.300596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7065-2cc8-4ede-93d4-2e2383627e92 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.309129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 887/1754] 10.222.0.45 () {54 vars in 912 bytes} [Fri Jun 17 15:12:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:12:50.310397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7065-2cc8-4ede-93d4-2e2383627e92 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:50.318406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 868/1755] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:50.326716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fcc34-bde6-459f-9d6c-71b91d3a402f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:50.362362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7065-2cc8-4ede-93d4-2e2383627e92 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.365667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fcc34-bde6-459f-9d6c-71b91d3a402f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.378140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d2598-b786-4317-a81a-368f60251c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.378928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d2598-b786-4317-a81a-368f60251c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.379288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d2598-b786-4317-a81a-368f60251c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.379463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d2598-b786-4317-a81a-368f60251c03 admin admin] PATH_INFO: `/v3/projects/4bd3e45290f54334ae3d42fcfa8dd19d/users/d5a2807237764867afb478efe10253db/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.387157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af098c-ab35-4b1a-9575-e8979552a306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.388143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af098c-ab35-4b1a-9575-e8979552a306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.388265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d2598-b786-4317-a81a-368f60251c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd3e45290f54334ae3d42fcfa8dd19d, user_id=d5a2807237764867afb478efe10253db, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:50.388424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af098c-ab35-4b1a-9575-e8979552a306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.388699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af098c-ab35-4b1a-9575-e8979552a306 admin admin] PATH_INFO: `/v3/projects/5a62085fa12c4aaaad10d19ea42b196d/users/80b475f40d9a46b58d93b1b6c0410403/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.394753 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d2598-b786-4317-a81a-368f60251c03 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:50.433594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 888/1756] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:50 2022] PUT /identity/v3/projects/4bd3e45290f54334ae3d42fcfa8dd19d/users/d5a2807237764867afb478efe10253db/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:50.434125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af098c-ab35-4b1a-9575-e8979552a306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a62085fa12c4aaaad10d19ea42b196d, user_id=80b475f40d9a46b58d93b1b6c0410403, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:50.435541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abe097-1125-46b4-b634-a1a38f5aeb30 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.435891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abe097-1125-46b4-b634-a1a38f5aeb30 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.436175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abe097-1125-46b4-b634-a1a38f5aeb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.439936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af098c-ab35-4b1a-9575-e8979552a306 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:50.466451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 869/1757] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:50 2022] PUT /identity/v3/projects/5a62085fa12c4aaaad10d19ea42b196d/users/80b475f40d9a46b58d93b1b6c0410403/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:50.466829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-23abe097-1125-46b4-b634-a1a38f5aeb30 None None] MFA Rules not processed for user `20745118f9eb436096a323ba2d22e94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:50.467303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af098c-ab35-4b1a-9575-e8979552a306 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:50.469790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-23abe097-1125-46b4-b634-a1a38f5aeb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:50.539238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:50.579627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af098c-ab35-4b1a-9575-e8979552a306 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.586262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8968a0-6725-4bc4-82d3-10f9bb47320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.587540 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8968a0-6725-4bc4-82d3-10f9bb47320f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.587970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8968a0-6725-4bc4-82d3-10f9bb47320f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.588572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8968a0-6725-4bc4-82d3-10f9bb47320f admin admin] PATH_INFO: `/v3/projects/40ddb4f38dfe4c5b93553be06c1ac1a0/users/f9db36dec5a34f93bc213563ba43df09/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.607331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8968a0-6725-4bc4-82d3-10f9bb47320f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ddb4f38dfe4c5b93553be06c1ac1a0, user_id=f9db36dec5a34f93bc213563ba43df09, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:50.609926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8968a0-6725-4bc4-82d3-10f9bb47320f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:50.625781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 889/1758] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:50.632699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a2f4d-21b2-4c49-84e5-ff77d5185ad6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.632916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 870/1759] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:50 2022] PUT /identity/v3/projects/40ddb4f38dfe4c5b93553be06c1ac1a0/users/f9db36dec5a34f93bc213563ba43df09/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:50.633414 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a2f4d-21b2-4c49-84e5-ff77d5185ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.634078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8968a0-6725-4bc4-82d3-10f9bb47320f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:50.635395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a2f4d-21b2-4c49-84e5-ff77d5185ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.710236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-963a2f4d-21b2-4c49-84e5-ff77d5185ad6 None None] MFA Rules not processed for user `d5a2807237764867afb478efe10253db`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:50.714784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-963a2f4d-21b2-4c49-84e5-ff77d5185ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:50.719273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8968a0-6725-4bc4-82d3-10f9bb47320f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.724329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7fb71-7c73-478b-ba9b-0916b3d9b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.725006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7fb71-7c73-478b-ba9b-0916b3d9b9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.725336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7fb71-7c73-478b-ba9b-0916b3d9b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.725615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7fb71-7c73-478b-ba9b-0916b3d9b9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.726345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7fb71-7c73-478b-ba9b-0916b3d9b9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:50.727999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7fb71-7c73-478b-ba9b-0916b3d9b9b7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:50.740007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 871/1760] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:50.740731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7fb71-7c73-478b-ba9b-0916b3d9b9b7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:50.758584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7fb71-7c73-478b-ba9b-0916b3d9b9b7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.773320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240d737-70c5-48f2-9546-c24581c20a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.774001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d737-70c5-48f2-9546-c24581c20a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.774424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d737-70c5-48f2-9546-c24581c20a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.775119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d737-70c5-48f2-9546-c24581c20a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.775488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240d737-70c5-48f2-9546-c24581c20a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:50.777165 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240d737-70c5-48f2-9546-c24581c20a8d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:50.810574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 872/1761] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:50.814697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240d737-70c5-48f2-9546-c24581c20a8d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:50.881785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:50.951871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 890/1762] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:50.957551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a2f4d-21b2-4c49-84e5-ff77d5185ad6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:50.978759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240d737-70c5-48f2-9546-c24581c20a8d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.982773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a2f4d-21b2-4c49-84e5-ff77d5185ad6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:50.987913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeeb24-be0b-4cbb-bbf2-d92bb1fba063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.988958 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeeb24-be0b-4cbb-bbf2-d92bb1fba063 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.990073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeeb24-be0b-4cbb-bbf2-d92bb1fba063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.990073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeeb24-be0b-4cbb-bbf2-d92bb1fba063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:50.993197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e60692-2be3-48a0-a918-073dc18f496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:50.996363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e60692-2be3-48a0-a918-073dc18f496b admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:50.997014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e60692-2be3-48a0-a918-073dc18f496b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:50.997660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e60692-2be3-48a0-a918-073dc18f496b admin admin] PATH_INFO: `/v3/projects/5a62085fa12c4aaaad10d19ea42b196d/users/80b475f40d9a46b58d93b1b6c0410403/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:51.008246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e60692-2be3-48a0-a918-073dc18f496b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a62085fa12c4aaaad10d19ea42b196d, user_id=80b475f40d9a46b58d93b1b6c0410403, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:51.011596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e60692-2be3-48a0-a918-073dc18f496b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:51.015013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaeeb24-be0b-4cbb-bbf2-d92bb1fba063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:51.018493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaeeb24-be0b-4cbb-bbf2-d92bb1fba063 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:51.042415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 873/1763] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:51.043644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeeb24-be0b-4cbb-bbf2-d92bb1fba063 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:51.052960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 891/1764] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:50 2022] PUT /identity/v3/projects/5a62085fa12c4aaaad10d19ea42b196d/users/80b475f40d9a46b58d93b1b6c0410403/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:51.052960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e60692-2be3-48a0-a918-073dc18f496b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:51.052960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-68e60692-2be3-48a0-a918-073dc18f496b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:51.076308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeeb24-be0b-4cbb-bbf2-d92bb1fba063 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:51.219033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e60692-2be3-48a0-a918-073dc18f496b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:51.229126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7a52e-c36b-44c5-9d85-64fa0ed8630d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:51.230869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7a52e-c36b-44c5-9d85-64fa0ed8630d service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:51.231257 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7a52e-c36b-44c5-9d85-64fa0ed8630d service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:51.233085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7a52e-c36b-44c5-9d85-64fa0ed8630d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:51.387183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7a52e-c36b-44c5-9d85-64fa0ed8630d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:51.388189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7a52e-c36b-44c5-9d85-64fa0ed8630d service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:51.389303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4032e7e-d15b-4708-9c44-4d1252a1642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:51.390417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4032e7e-d15b-4708-9c44-4d1252a1642e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:51.396349 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4032e7e-d15b-4708-9c44-4d1252a1642e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:51.396816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4032e7e-d15b-4708-9c44-4d1252a1642e admin admin] PATH_INFO: `/v3/projects/40ddb4f38dfe4c5b93553be06c1ac1a0/users/f9db36dec5a34f93bc213563ba43df09/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:51.405017 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4032e7e-d15b-4708-9c44-4d1252a1642e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ddb4f38dfe4c5b93553be06c1ac1a0, user_id=f9db36dec5a34f93bc213563ba43df09, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:51.409904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 892/1765] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:51.412717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f149436-e66d-4696-b1c2-6d02249a4914 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:51.416564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f149436-e66d-4696-b1c2-6d02249a4914 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:51.416981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f149436-e66d-4696-b1c2-6d02249a4914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:51.424653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4032e7e-d15b-4708-9c44-4d1252a1642e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:51.490547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:51.492558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 874/1766] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:51 2022] PUT /identity/v3/projects/40ddb4f38dfe4c5b93553be06c1ac1a0/users/f9db36dec5a34f93bc213563ba43df09/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:51.506700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3f149436-e66d-4696-b1c2-6d02249a4914 None None] MFA Rules not processed for user `80b475f40d9a46b58d93b1b6c0410403`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:51.507401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf023a97-ac60-4def-b0c4-3ddb7b145ab7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:51.509825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf023a97-ac60-4def-b0c4-3ddb7b145ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:51.510617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3f149436-e66d-4696-b1c2-6d02249a4914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:51.513486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf023a97-ac60-4def-b0c4-3ddb7b145ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:51.592364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bf023a97-ac60-4def-b0c4-3ddb7b145ab7 None None] MFA Rules not processed for user `f9db36dec5a34f93bc213563ba43df09`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:51.594473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bf023a97-ac60-4def-b0c4-3ddb7b145ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:51.787086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 875/1767] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:51.788208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 893/1768] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:51.788303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151329e-310b-4971-816e-886f0e074930 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:51.788303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151329e-310b-4971-816e-886f0e074930 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:51.788303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151329e-310b-4971-816e-886f0e074930 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:51.798186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f149436-e66d-4696-b1c2-6d02249a4914 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:51.799619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3f149436-e66d-4696-b1c2-6d02249a4914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:51.803130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 876/1769] 10.222.0.45 () {54 vars in 960 bytes} [Fri Jun 17 15:12:51 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:12:51.804730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb0ac-09fb-42cb-ae35-aa5836aa6f6c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:51.805085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb0ac-09fb-42cb-ae35-aa5836aa6f6c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:51.805454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb0ac-09fb-42cb-ae35-aa5836aa6f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:51.852841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-60fbb0ac-09fb-42cb-ae35-aa5836aa6f6c None None] MFA Rules not processed for user `328d0413dc65420c841b452f45c5b0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:51.854522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-60fbb0ac-09fb-42cb-ae35-aa5836aa6f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:51.948157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:51.988689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f149436-e66d-4696-b1c2-6d02249a4914 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:52.000942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be60c0-2062-41ea-99df-c3af5b3503a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:52.005392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be60c0-2062-41ea-99df-c3af5b3503a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:52.006308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be60c0-2062-41ea-99df-c3af5b3503a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:52.007585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be60c0-2062-41ea-99df-c3af5b3503a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:52.046328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be60c0-2062-41ea-99df-c3af5b3503a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:52.049384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be60c0-2062-41ea-99df-c3af5b3503a5 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:52.088004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 894/1770] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:52.090919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be60c0-2062-41ea-99df-c3af5b3503a5 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:52.098580 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 877/1771] 10.222.0.45 () {58 vars in 1057 bytes} [Fri Jun 17 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:52.099676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbb0ac-09fb-42cb-ae35-aa5836aa6f6c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:52.110733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be60c0-2062-41ea-99df-c3af5b3503a5 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:52.132182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c48191-1191-4faf-a046-7e0902830bea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:52.133042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c48191-1191-4faf-a046-7e0902830bea service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:52.133790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c48191-1191-4faf-a046-7e0902830bea service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:52.134491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c48191-1191-4faf-a046-7e0902830bea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:52.158157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbb0ac-09fb-42cb-ae35-aa5836aa6f6c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:52.164610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c48191-1191-4faf-a046-7e0902830bea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:52.168503 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c48191-1191-4faf-a046-7e0902830bea service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:52.186961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318566-32c4-4180-8fb8-15c74ce0c56c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:52.192960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318566-32c4-4180-8fb8-15c74ce0c56c service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:52.194326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318566-32c4-4180-8fb8-15c74ce0c56c service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:52.195001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318566-32c4-4180-8fb8-15c74ce0c56c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:52.201194 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-19318566-32c4-4180-8fb8-15c74ce0c56c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:52.211353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 895/1772] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:52.264449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318566-32c4-4180-8fb8-15c74ce0c56c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:52.267220 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318566-32c4-4180-8fb8-15c74ce0c56c service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:52.326003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 878/1773] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:52.389033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c48191-1191-4faf-a046-7e0902830bea service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:52.400180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c48191-1191-4faf-a046-7e0902830bea service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:52.411182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a17a34-74cc-4eae-9ab3-b6e2b1cc4b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:52.413477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a17a34-74cc-4eae-9ab3-b6e2b1cc4b4e service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:52.413826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a17a34-74cc-4eae-9ab3-b6e2b1cc4b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:52.414111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a17a34-74cc-4eae-9ab3-b6e2b1cc4b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:52.644334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a17a34-74cc-4eae-9ab3-b6e2b1cc4b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:52.649288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a17a34-74cc-4eae-9ab3-b6e2b1cc4b4e service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:52.680413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 896/1774] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:52.929023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5084d10-5a15-44ca-add3-1c91106c8c6c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:52.929600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5084d10-5a15-44ca-add3-1c91106c8c6c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:52.929737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5084d10-5a15-44ca-add3-1c91106c8c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:52.998015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f5084d10-5a15-44ca-add3-1c91106c8c6c None None] MFA Rules not processed for user `81f7520d68b3473cbba90d8581afbfac`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:53.004197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f5084d10-5a15-44ca-add3-1c91106c8c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:53.163167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868252f-699d-4e80-afc9-bd3c2527024a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:53.163543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868252f-699d-4e80-afc9-bd3c2527024a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:53.163827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868252f-699d-4e80-afc9-bd3c2527024a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:53.229297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c868252f-699d-4e80-afc9-bd3c2527024a None None] MFA Rules not processed for user `0a6708681b7549fcba86b5a7f3d0d0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:53.237936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c868252f-699d-4e80-afc9-bd3c2527024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:53.276625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 879/1775] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:53.314571 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:53.428634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 897/1776] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:53.601479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5084d10-5a15-44ca-add3-1c91106c8c6c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:53.604456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f5084d10-5a15-44ca-add3-1c91106c8c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:53.627760 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868252f-699d-4e80-afc9-bd3c2527024a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:53.649699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868252f-699d-4e80-afc9-bd3c2527024a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:53.659118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c314dda-8217-4570-a872-d887a09f9094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:53.660019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c314dda-8217-4570-a872-d887a09f9094 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:53.665140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c314dda-8217-4570-a872-d887a09f9094 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:53.665573 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c314dda-8217-4570-a872-d887a09f9094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:53.862291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5084d10-5a15-44ca-add3-1c91106c8c6c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:53.902171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:53.914851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:53.917264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:53.917746 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] PATH_INFO: `/v3/users/13e2c40f03c147cbb60ae87cf3b488c9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:53.923530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e2c40f03c147cbb60ae87cf3b488c9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:53.928931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:53.954318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c314dda-8217-4570-a872-d887a09f9094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:53.958776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c314dda-8217-4570-a872-d887a09f9094 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:54.021535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 898/1777] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:12:54.109696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e2c40f03c147cbb60ae87cf3b488c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:54.145924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e2c40f03c147cbb60ae87cf3b488c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:54.146826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e2c40f03c147cbb60ae87cf3b488c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:54.147392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c314dda-8217-4570-a872-d887a09f9094 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:54.162013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c314dda-8217-4570-a872-d887a09f9094 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:54.170504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e2c40f03c147cbb60ae87cf3b488c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:54.177934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248800eb-71eb-4ee1-8f04-09656e198d7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:54.178713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248800eb-71eb-4ee1-8f04-09656e198d7a service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:54.179092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248800eb-71eb-4ee1-8f04-09656e198d7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:54.179468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248800eb-71eb-4ee1-8f04-09656e198d7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:54.181537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:54.196853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1628683-9049-43f6-a549-73bc1f1d0fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e2c40f03c147cbb60ae87cf3b488c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:54.219607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 880/1778] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:12:53 2022] DELETE /identity/v3/users/13e2c40f03c147cbb60ae87cf3b488c9 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:54.222624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47e2d4-0206-4760-b20d-0306cec8418a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:54.223108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47e2d4-0206-4760-b20d-0306cec8418a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:54.223391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47e2d4-0206-4760-b20d-0306cec8418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:54.285442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5a47e2d4-0206-4760-b20d-0306cec8418a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:54.290502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5a47e2d4-0206-4760-b20d-0306cec8418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:54.507665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 881/1779] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:54.511761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248800eb-71eb-4ee1-8f04-09656e198d7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:54.514731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248800eb-71eb-4ee1-8f04-09656e198d7a service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:54.521447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47e2d4-0206-4760-b20d-0306cec8418a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:54.524151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5a47e2d4-0206-4760-b20d-0306cec8418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:54.578746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 899/1780] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:12:54.646882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47e2d4-0206-4760-b20d-0306cec8418a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:54.651312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cda94-0579-4c6c-a48b-e5602d7c27c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:54.652029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cda94-0579-4c6c-a48b-e5602d7c27c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:54.652362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cda94-0579-4c6c-a48b-e5602d7c27c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:54.652647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cda94-0579-4c6c-a48b-e5602d7c27c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:54.664508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cda94-0579-4c6c-a48b-e5602d7c27c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:54.666018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cda94-0579-4c6c-a48b-e5602d7c27c1 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:54.690079 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 882/1781] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:12:55.636224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248800eb-71eb-4ee1-8f04-09656e198d7a service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:55.655247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248800eb-71eb-4ee1-8f04-09656e198d7a service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:55.676112 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:55.677251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:55.680198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:55.681563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] PATH_INFO: `/v3/projects/aa105734912041de80575993a17083bf` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:55.688592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa105734912041de80575993a17083bf)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:55.691417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:55.961133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa105734912041de80575993a17083bf', 'request_id': 'req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:55.989928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa105734912041de80575993a17083bf', 'request_id': 'req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:56.001324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:56.019019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa105734912041de80575993a17083bf', 'request_id': 'req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:56.055282 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] The token cache is being invalidate because project aa105734912041de80575993a17083bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:12:56.055860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:56.057323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:56.064407 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 900/1782] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:12:55 2022] DELETE /identity/v3/projects/aa105734912041de80575993a17083bf => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:56.065638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cda94-0579-4c6c-a48b-e5602d7c27c1 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:56.067208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7a1cda94-0579-4c6c-a48b-e5602d7c27c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:56.108910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cda94-0579-4c6c-a48b-e5602d7c27c1 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:56.232565 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:56.233626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:56.234005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:56.234386 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] PATH_INFO: `/v3/users/04e8eb62cfe4417e9858e81815b349e7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:56.235789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e8eb62cfe4417e9858e81815b349e7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:56.238009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:56.329802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:56.372069 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e8eb62cfe4417e9858e81815b349e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:56.383571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e8eb62cfe4417e9858e81815b349e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:56.386836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e8eb62cfe4417e9858e81815b349e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:56.409915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e8eb62cfe4417e9858e81815b349e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:56.440242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b038652-2107-4941-b7db-1b5058dda3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e8eb62cfe4417e9858e81815b349e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:56.461096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 883/1783] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:12:56 2022] DELETE /identity/v3/users/04e8eb62cfe4417e9858e81815b349e7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:12:57.308149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:57.311045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:57.364179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27ea8-f14f-42d5-af6f-c57164aec8f6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:57.702494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:57.704069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:57.704500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:57.704943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] PATH_INFO: `/v3/projects/ae4600a3c8c74467a841f93bd12ef3e7` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:57.706650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4600a3c8c74467a841f93bd12ef3e7)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:57.708981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:57.805931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4600a3c8c74467a841f93bd12ef3e7', 'request_id': 'req-feb0afae-f6d8-4710-b4c2-98f058fedb96'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:57.822317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4600a3c8c74467a841f93bd12ef3e7', 'request_id': 'req-feb0afae-f6d8-4710-b4c2-98f058fedb96'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:57.848080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4600a3c8c74467a841f93bd12ef3e7', 'request_id': 'req-feb0afae-f6d8-4710-b4c2-98f058fedb96'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:57.878813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] The token cache is being invalidate because project ae4600a3c8c74467a841f93bd12ef3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:12:57.879229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:57.879967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-feb0afae-f6d8-4710-b4c2-98f058fedb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:12:57.882171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 901/1784] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:12:57 2022] DELETE /identity/v3/projects/ae4600a3c8c74467a841f93bd12ef3e7 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:57.888461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f33be-6d3a-4682-9b2e-f64ca53ab0c9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:57.889062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f33be-6d3a-4682-9b2e-f64ca53ab0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:57.889062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f33be-6d3a-4682-9b2e-f64ca53ab0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:57.961714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-792f33be-6d3a-4682-9b2e-f64ca53ab0c9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:57.963101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-792f33be-6d3a-4682-9b2e-f64ca53ab0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:58.000320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674b48a-f9be-4f49-a570-fcc66b80b089 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:58.002533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674b48a-f9be-4f49-a570-fcc66b80b089 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:58.003024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674b48a-f9be-4f49-a570-fcc66b80b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:58.044180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4674b48a-f9be-4f49-a570-fcc66b80b089 None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:58.049465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4674b48a-f9be-4f49-a570-fcc66b80b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:58.219466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 884/1785] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:58.222777 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a01f2-9f9e-4bff-ae00-a4ba35b98526 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:58.223264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a01f2-9f9e-4bff-ae00-a4ba35b98526 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:58.223642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a01f2-9f9e-4bff-ae00-a4ba35b98526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:58.254768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 902/1786] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:12:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:58.288424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-316a01f2-9f9e-4bff-ae00-a4ba35b98526 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:58.293177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-316a01f2-9f9e-4bff-ae00-a4ba35b98526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:58.311631 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 885/1787] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:58.316149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674b48a-f9be-4f49-a570-fcc66b80b089 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:58.344013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674b48a-f9be-4f49-a570-fcc66b80b089 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:58.356206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094b3fd-40b7-418f-9f0d-ae1958ab92ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:58.356900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094b3fd-40b7-418f-9f0d-ae1958ab92ae admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:58.361686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094b3fd-40b7-418f-9f0d-ae1958ab92ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:58.362180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094b3fd-40b7-418f-9f0d-ae1958ab92ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:58.363395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094b3fd-40b7-418f-9f0d-ae1958ab92ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:12:58.363859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094b3fd-40b7-418f-9f0d-ae1958ab92ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:58.368526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094b3fd-40b7-418f-9f0d-ae1958ab92ae admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:58.394518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 903/1788] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:12:58.395885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a01f2-9f9e-4bff-ae00-a4ba35b98526 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:58.417770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a01f2-9f9e-4bff-ae00-a4ba35b98526 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:58.433509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b973b3-263d-459f-a433-12af2f4eee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:58.435407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b973b3-263d-459f-a433-12af2f4eee87 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:58.440356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b973b3-263d-459f-a433-12af2f4eee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:58.440632 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b973b3-263d-459f-a433-12af2f4eee87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:58.441516 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b973b3-263d-459f-a433-12af2f4eee87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:58.445980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b973b3-263d-459f-a433-12af2f4eee87 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:58.529251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 886/1789] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:58 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:58.530675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094b3fd-40b7-418f-9f0d-ae1958ab92ae admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:58.542391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094b3fd-40b7-418f-9f0d-ae1958ab92ae admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:58.550379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b973b3-263d-459f-a433-12af2f4eee87 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:58.555017 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-04b973b3-263d-459f-a433-12af2f4eee87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:58.566763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:58.726311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa1f83-51c8-49be-a811-f68af50650bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:58.728245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa1f83-51c8-49be-a811-f68af50650bb admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:58.728998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa1f83-51c8-49be-a811-f68af50650bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:58.729451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa1f83-51c8-49be-a811-f68af50650bb admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:58.731639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa1f83-51c8-49be-a811-f68af50650bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:58.740121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa1f83-51c8-49be-a811-f68af50650bb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:58.800873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 904/1790] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:58 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:12:58.808523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa1f83-51c8-49be-a811-f68af50650bb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:58.823747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa1f83-51c8-49be-a811-f68af50650bb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:58.833860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a172e-5300-4718-b3df-3962d0575eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:58.834807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a172e-5300-4718-b3df-3962d0575eef admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:58.835181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a172e-5300-4718-b3df-3962d0575eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:58.835767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a172e-5300-4718-b3df-3962d0575eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:58.838422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a172e-5300-4718-b3df-3962d0575eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:58.841847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a172e-5300-4718-b3df-3962d0575eef admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:58.857696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b973b3-263d-459f-a433-12af2f4eee87 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:58.871002 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 905/1791] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:58.877994 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a172e-5300-4718-b3df-3962d0575eef admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:58.891164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5f91d-645a-446e-8e36-f549a2f1862c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:58.892526 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f91d-645a-446e-8e36-f549a2f1862c service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:58.893045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f91d-645a-446e-8e36-f549a2f1862c service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:58.893506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f91d-645a-446e-8e36-f549a2f1862c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:58.925079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a172e-5300-4718-b3df-3962d0575eef admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:58.949659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaefcce-c0f9-454a-ad70-e2f0eca341cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:58.950556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaefcce-c0f9-454a-ad70-e2f0eca341cf admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:58.950929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaefcce-c0f9-454a-ad70-e2f0eca341cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:58.951487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaefcce-c0f9-454a-ad70-e2f0eca341cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:58.955328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaefcce-c0f9-454a-ad70-e2f0eca341cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:58.960312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaefcce-c0f9-454a-ad70-e2f0eca341cf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:58.995357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:59.008510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 906/1792] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:12:59.011572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaefcce-c0f9-454a-ad70-e2f0eca341cf admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:59.048283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaefcce-c0f9-454a-ad70-e2f0eca341cf admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:59.087725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dece952-88de-4cd1-b161-4d7eb44f4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:59.091713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dece952-88de-4cd1-b161-4d7eb44f4d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:59.092628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dece952-88de-4cd1-b161-4d7eb44f4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:59.092921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dece952-88de-4cd1-b161-4d7eb44f4d24 admin admin] PATH_INFO: `/v3/projects/36a63e8cfcf5410495b886fd8462f058/users/0229f60f1b8448799b8356ea661c8801/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:59.159629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5f91d-645a-446e-8e36-f549a2f1862c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:59.161031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dece952-88de-4cd1-b161-4d7eb44f4d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a63e8cfcf5410495b886fd8462f058, user_id=0229f60f1b8448799b8356ea661c8801, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:59.162903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5f91d-645a-446e-8e36-f549a2f1862c service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:59.171958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dece952-88de-4cd1-b161-4d7eb44f4d24 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:59.196068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 887/1793] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:12:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:12:59.240288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 907/1794] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:12:59 2022] PUT /identity/v3/projects/36a63e8cfcf5410495b886fd8462f058/users/0229f60f1b8448799b8356ea661c8801/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:12:59.251813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af27e-33c2-424e-aa21-d9e3076a3c43 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:59.252109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af27e-33c2-424e-aa21-d9e3076a3c43 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:59.252391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af27e-33c2-424e-aa21-d9e3076a3c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:59.382632 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b45af27e-33c2-424e-aa21-d9e3076a3c43 None None] MFA Rules not processed for user `0229f60f1b8448799b8356ea661c8801`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:12:59.388841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b45af27e-33c2-424e-aa21-d9e3076a3c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:59.508971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dece952-88de-4cd1-b161-4d7eb44f4d24 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:59.511330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7dece952-88de-4cd1-b161-4d7eb44f4d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:12:59.652898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 888/1795] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:12:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:12:59.657954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45af27e-33c2-424e-aa21-d9e3076a3c43 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:12:59.849154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dece952-88de-4cd1-b161-4d7eb44f4d24 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:59.858229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45af27e-33c2-424e-aa21-d9e3076a3c43 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:12:59.864886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdeb85-b193-4c39-927e-393c1a57a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:59.865892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdeb85-b193-4c39-927e-393c1a57a813 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:59.866319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdeb85-b193-4c39-927e-393c1a57a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:59.866550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdeb85-b193-4c39-927e-393c1a57a813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:59.867368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdeb85-b193-4c39-927e-393c1a57a813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:59.869803 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdeb85-b193-4c39-927e-393c1a57a813 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:59.875867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:12:59.880515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:12:59.880803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:12:59.881081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] PATH_INFO: `/v3/users/87bc08bf69114454ac1df066ed06228a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:12:59.888436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87bc08bf69114454ac1df066ed06228a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:12:59.894686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:12:59.926655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 889/1796] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:12:59 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:12:59.928973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdeb85-b193-4c39-927e-393c1a57a813 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:00.008962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:00.086908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdeb85-b193-4c39-927e-393c1a57a813 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:00.088477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87bc08bf69114454ac1df066ed06228a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:00.099392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:00.100359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab9943-7e65-4965-ad26-bfcfe9130620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:00.104726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab9943-7e65-4965-ad26-bfcfe9130620 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:00.105048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab9943-7e65-4965-ad26-bfcfe9130620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:00.105375 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab9943-7e65-4965-ad26-bfcfe9130620 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:00.106253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab9943-7e65-4965-ad26-bfcfe9130620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:00.111931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87bc08bf69114454ac1df066ed06228a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:00.114804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab9943-7e65-4965-ad26-bfcfe9130620 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:00.114939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87bc08bf69114454ac1df066ed06228a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:00.134446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87bc08bf69114454ac1df066ed06228a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:00.135330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8063f5bc-77d4-4d73-a519-cb5c76eb7ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87bc08bf69114454ac1df066ed06228a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:00.183637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 908/1797] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:12:59 2022] DELETE /identity/v3/users/87bc08bf69114454ac1df066ed06228a => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:00.185485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7afd4e-040e-4eca-9e0d-8778971d3b34 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:00.187061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 890/1798] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:12:59 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:00.187186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7afd4e-040e-4eca-9e0d-8778971d3b34 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:00.187186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7afd4e-040e-4eca-9e0d-8778971d3b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:00.190911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab9943-7e65-4965-ad26-bfcfe9130620 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:00.196906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e3ab9943-7e65-4965-ad26-bfcfe9130620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:00.234179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8a7afd4e-040e-4eca-9e0d-8778971d3b34 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:00.235958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8a7afd4e-040e-4eca-9e0d-8778971d3b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:00.241693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab9943-7e65-4965-ad26-bfcfe9130620 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:00.411068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 909/1799] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:00.558148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5898733-a1eb-4eb2-9dcb-880b79edb41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:00.559346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5898733-a1eb-4eb2-9dcb-880b79edb41b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:00.559827 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5898733-a1eb-4eb2-9dcb-880b79edb41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:00.560339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5898733-a1eb-4eb2-9dcb-880b79edb41b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:00.562334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5898733-a1eb-4eb2-9dcb-880b79edb41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:00.571269 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5898733-a1eb-4eb2-9dcb-880b79edb41b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:00.608924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7afd4e-040e-4eca-9e0d-8778971d3b34 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:00.611789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8a7afd4e-040e-4eca-9e0d-8778971d3b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:00.634446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 891/1800] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:00.641959 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5898733-a1eb-4eb2-9dcb-880b79edb41b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:00.675483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5898733-a1eb-4eb2-9dcb-880b79edb41b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:00.693015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc79489-b8b5-4ab1-b098-cb8d6c81cd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:00.694722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc79489-b8b5-4ab1-b098-cb8d6c81cd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:00.695198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc79489-b8b5-4ab1-b098-cb8d6c81cd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:00.695833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc79489-b8b5-4ab1-b098-cb8d6c81cd7d admin admin] PATH_INFO: `/v3/projects/34d0f6be3db84803a3855c8f2500b0b8/users/249b73c69b844f0ba1066096b3d8fc25/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:00.723319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc79489-b8b5-4ab1-b098-cb8d6c81cd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d0f6be3db84803a3855c8f2500b0b8, user_id=249b73c69b844f0ba1066096b3d8fc25, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:00.731231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc79489-b8b5-4ab1-b098-cb8d6c81cd7d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:00.770820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 892/1801] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:00 2022] PUT /identity/v3/projects/34d0f6be3db84803a3855c8f2500b0b8/users/249b73c69b844f0ba1066096b3d8fc25/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:00.773096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc79489-b8b5-4ab1-b098-cb8d6c81cd7d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:00.820700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7afd4e-040e-4eca-9e0d-8778971d3b34 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:01.007292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ddfa1-75de-4cc7-83d1-462b51796963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:01.008100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ddfa1-75de-4cc7-83d1-462b51796963 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:01.008385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ddfa1-75de-4cc7-83d1-462b51796963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:01.008662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ddfa1-75de-4cc7-83d1-462b51796963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:01.064529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc79489-b8b5-4ab1-b098-cb8d6c81cd7d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:01.079906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd16de5-7204-4b58-b8a4-67341e49a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:01.084871 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd16de5-7204-4b58-b8a4-67341e49a092 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:01.085520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd16de5-7204-4b58-b8a4-67341e49a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:01.086052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd16de5-7204-4b58-b8a4-67341e49a092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:01.087072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd16de5-7204-4b58-b8a4-67341e49a092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:01.097406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:01.107245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd16de5-7204-4b58-b8a4-67341e49a092 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:01.148082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ddfa1-75de-4cc7-83d1-462b51796963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:01.149826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ddfa1-75de-4cc7-83d1-462b51796963 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:01.173303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 893/1802] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:01.173928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 910/1803] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:01.174821 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ddfa1-75de-4cc7-83d1-462b51796963 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:01.175563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd16de5-7204-4b58-b8a4-67341e49a092 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:01.185240 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0fd16de5-7204-4b58-b8a4-67341e49a092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:01.205049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ddfa1-75de-4cc7-83d1-462b51796963 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:01.234348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dc2c8-5df1-42aa-bffd-7f566cb87303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:01.235419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dc2c8-5df1-42aa-bffd-7f566cb87303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:01.235709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dc2c8-5df1-42aa-bffd-7f566cb87303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:01.237449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dc2c8-5df1-42aa-bffd-7f566cb87303 admin admin] PATH_INFO: `/v3/projects/34d0f6be3db84803a3855c8f2500b0b8/users/249b73c69b844f0ba1066096b3d8fc25/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:01.242034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dc2c8-5df1-42aa-bffd-7f566cb87303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d0f6be3db84803a3855c8f2500b0b8, user_id=249b73c69b844f0ba1066096b3d8fc25, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:01.252981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dc2c8-5df1-42aa-bffd-7f566cb87303 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:01.302881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 911/1804] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:01 2022] PUT /identity/v3/projects/34d0f6be3db84803a3855c8f2500b0b8/users/249b73c69b844f0ba1066096b3d8fc25/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:01.314418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a454cb-a855-4907-ade5-1c301b989210 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:01.314709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a454cb-a855-4907-ade5-1c301b989210 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:01.314963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a454cb-a855-4907-ade5-1c301b989210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:01.395646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-26a454cb-a855-4907-ade5-1c301b989210 None None] MFA Rules not processed for user `249b73c69b844f0ba1066096b3d8fc25`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:01.405818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-26a454cb-a855-4907-ade5-1c301b989210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:01.421735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:01.476180 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd16de5-7204-4b58-b8a4-67341e49a092 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:01.652718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 912/1805] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:01.706241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bdc8d-4ac9-44e8-9d0c-1ae364be3ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:01.707190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bdc8d-4ac9-44e8-9d0c-1ae364be3ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:01.707679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bdc8d-4ac9-44e8-9d0c-1ae364be3ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:01.708193 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bdc8d-4ac9-44e8-9d0c-1ae364be3ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:01.725104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e13bdc8d-4ac9-44e8-9d0c-1ae364be3ce3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:01.773176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a454cb-a855-4907-ade5-1c301b989210 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:01.774917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-26a454cb-a855-4907-ade5-1c301b989210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:01.823927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a454cb-a855-4907-ade5-1c301b989210 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:01.838059 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f6d9-1a41-41ef-b427-99099ed9164a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:01.838866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f6d9-1a41-41ef-b427-99099ed9164a service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:01.839251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f6d9-1a41-41ef-b427-99099ed9164a service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:01.839623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f6d9-1a41-41ef-b427-99099ed9164a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:01.848315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a231f6d9-1a41-41ef-b427-99099ed9164a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:01.886543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bdc8d-4ac9-44e8-9d0c-1ae364be3ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:01.888314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bdc8d-4ac9-44e8-9d0c-1ae364be3ce3 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:01.947081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 894/1806] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:02.108254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb18f16-777e-4408-b983-33f47d3bfbe9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:02.115080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb18f16-777e-4408-b983-33f47d3bfbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:02.115080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb18f16-777e-4408-b983-33f47d3bfbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:02.125836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231f6d9-1a41-41ef-b427-99099ed9164a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:02.135084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231f6d9-1a41-41ef-b427-99099ed9164a service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:02.169626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 913/1807] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:02.175767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0cb18f16-777e-4408-b983-33f47d3bfbe9 None None] MFA Rules not processed for user `20745118f9eb436096a323ba2d22e94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:02.176964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0cb18f16-777e-4408-b983-33f47d3bfbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:02.418277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 895/1808] 10.222.0.25 () {58 vars in 1015 bytes} [Fri Jun 17 15:13:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:02.771043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f6d9-1a41-41ef-b427-99099ed9164a service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:02.773843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a231f6d9-1a41-41ef-b427-99099ed9164a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:02.820533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f6d9-1a41-41ef-b427-99099ed9164a service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:02.840475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8167d8-5e5b-4a57-ae1e-94f8800c2975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:02.841169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8167d8-5e5b-4a57-ae1e-94f8800c2975 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:02.841491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8167d8-5e5b-4a57-ae1e-94f8800c2975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:02.841773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8167d8-5e5b-4a57-ae1e-94f8800c2975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:02.878144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8167d8-5e5b-4a57-ae1e-94f8800c2975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:02.885422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8167d8-5e5b-4a57-ae1e-94f8800c2975 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:02.931639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 914/1809] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:03.014838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb18f16-777e-4408-b983-33f47d3bfbe9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:03.026194 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb18f16-777e-4408-b983-33f47d3bfbe9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:03.044923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cce0af-a18d-4b0b-a98f-42bfc9cc3ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:03.047929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cce0af-a18d-4b0b-a98f-42bfc9cc3ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:03.051440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cce0af-a18d-4b0b-a98f-42bfc9cc3ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:03.052037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cce0af-a18d-4b0b-a98f-42bfc9cc3ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:03.077166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cce0af-a18d-4b0b-a98f-42bfc9cc3ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:03.079562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cce0af-a18d-4b0b-a98f-42bfc9cc3ad7 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:03.106151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 896/1810] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:04.668836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8167d8-5e5b-4a57-ae1e-94f8800c2975 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:04.671901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-af8167d8-5e5b-4a57-ae1e-94f8800c2975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:04.816902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:04.977701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8167d8-5e5b-4a57-ae1e-94f8800c2975 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:05.009867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:05.010818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:05.011099 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:05.011545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] PATH_INFO: `/v3/projects/a4a50e2497854643a7c1364d07983481` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:05.014030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a50e2497854643a7c1364d07983481)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:05.023226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:05.232054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a50e2497854643a7c1364d07983481', 'request_id': 'req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:05.258798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a50e2497854643a7c1364d07983481', 'request_id': 'req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:05.282787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a50e2497854643a7c1364d07983481', 'request_id': 'req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:05.311555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] The token cache is being invalidate because project a4a50e2497854643a7c1364d07983481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:05.311916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:05.315598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:05.326914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cce0af-a18d-4b0b-a98f-42bfc9cc3ad7 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:05.327495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 915/1811] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:04 2022] DELETE /identity/v3/projects/a4a50e2497854643a7c1364d07983481 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:05.354908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cce0af-a18d-4b0b-a98f-42bfc9cc3ad7 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:05.504093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:05.608665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:05.609607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:05.609963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:05.612852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] PATH_INFO: `/v3/users/d5a2807237764867afb478efe10253db` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:05.615040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a2807237764867afb478efe10253db)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:05.625246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:05.848656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a2807237764867afb478efe10253db'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:05.881847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a2807237764867afb478efe10253db'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:05.885638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a2807237764867afb478efe10253db'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:05.918578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a2807237764867afb478efe10253db'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:05.983986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a2807237764867afb478efe10253db'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:06.009510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 897/1812] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:05 2022] DELETE /identity/v3/users/d5a2807237764867afb478efe10253db => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:06.314016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:06.315752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:06.343684 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:06.345459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:06.355932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d04b6-9a45-482a-a535-0c4cb5b3e6be admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:06.553869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c693-c055-4e98-89cd-fd30f3ccd0cd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:06.565092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0c1e1-72ae-4bdd-9ebb-0e9e5384851b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:06.568230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0c1e1-72ae-4bdd-9ebb-0e9e5384851b service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:06.568230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0c1e1-72ae-4bdd-9ebb-0e9e5384851b service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:06.569451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0c1e1-72ae-4bdd-9ebb-0e9e5384851b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:06.573261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-28b0c1e1-72ae-4bdd-9ebb-0e9e5384851b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:06.629627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:06.642449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:06.642738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:06.647261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] PATH_INFO: `/v3/users/f890c880d5044e90ac5f3d97815a7388` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:06.658377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f890c880d5044e90ac5f3d97815a7388)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:06.662488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:06.894196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f890c880d5044e90ac5f3d97815a7388'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:06.903531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0c1e1-72ae-4bdd-9ebb-0e9e5384851b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:06.908064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0c1e1-72ae-4bdd-9ebb-0e9e5384851b service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:06.920984 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f890c880d5044e90ac5f3d97815a7388'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:06.921831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f890c880d5044e90ac5f3d97815a7388'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:06.929957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 898/1813] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:06.932987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f890c880d5044e90ac5f3d97815a7388'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:06.934001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f890c880d5044e90ac5f3d97815a7388'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:06.936535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:06.999647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 916/1814] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:06 2022] DELETE /identity/v3/users/f890c880d5044e90ac5f3d97815a7388 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:07.006994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe06f-5c46-45f8-8af1-d68e0e7101e2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:07.007574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe06f-5c46-45f8-8af1-d68e0e7101e2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:07.008083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe06f-5c46-45f8-8af1-d68e0e7101e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:07.049069 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2d5fe06f-5c46-45f8-8af1-d68e0e7101e2 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:07.050848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2d5fe06f-5c46-45f8-8af1-d68e0e7101e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:07.062163 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:07.246219 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 899/1815] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:07.828714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:07.830467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:08.030393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7440c69-0485-473f-ac2d-d66290fecc82 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:08.044147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a8d4f-f368-407d-9336-6e5b219495d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:08.045004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a8d4f-f368-407d-9336-6e5b219495d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:08.045735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a8d4f-f368-407d-9336-6e5b219495d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:08.046481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a8d4f-f368-407d-9336-6e5b219495d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:08.077766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a8d4f-f368-407d-9336-6e5b219495d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:08.082344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a8d4f-f368-407d-9336-6e5b219495d3 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:08.109516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 917/1816] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:08.614606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9de66-2025-4aa2-bd22-cc0773c54247 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:08.615345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9de66-2025-4aa2-bd22-cc0773c54247 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:08.615804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9de66-2025-4aa2-bd22-cc0773c54247 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:08.618286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 900/1817] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:13:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:13:08.685468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396b8b-d838-4cb1-81c5-834d0d657e9b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:08.685760 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396b8b-d838-4cb1-81c5-834d0d657e9b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:08.686044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396b8b-d838-4cb1-81c5-834d0d657e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:08.733288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3c396b8b-d838-4cb1-81c5-834d0d657e9b None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:08.734724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3c396b8b-d838-4cb1-81c5-834d0d657e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:08.913354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 918/1818] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:13:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:09.329052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9de66-2025-4aa2-bd22-cc0773c54247 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:09.330852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c6d9de66-2025-4aa2-bd22-cc0773c54247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:09.368074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9de66-2025-4aa2-bd22-cc0773c54247 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:09.385094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc0c66-93e8-4ed3-88c8-02a19a7967f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:09.389969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc0c66-93e8-4ed3-88c8-02a19a7967f6 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:09.391531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc0c66-93e8-4ed3-88c8-02a19a7967f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:09.392969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc0c66-93e8-4ed3-88c8-02a19a7967f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:09.418297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc0c66-93e8-4ed3-88c8-02a19a7967f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:09.419672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc0c66-93e8-4ed3-88c8-02a19a7967f6 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:09.451082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 901/1819] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:09.915406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea2e1c-9f65-46a0-af50-a3ed67d6799a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:09.916325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea2e1c-9f65-46a0-af50-a3ed67d6799a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:09.916750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea2e1c-9f65-46a0-af50-a3ed67d6799a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:09.918653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 919/1820] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:13:09.966259 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18172ae-7ad0-4be4-8b31-cef6d414992d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:09.966914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18172ae-7ad0-4be4-8b31-cef6d414992d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:09.966914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18172ae-7ad0-4be4-8b31-cef6d414992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:10.010598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c18172ae-7ad0-4be4-8b31-cef6d414992d None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:10.014235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c18172ae-7ad0-4be4-8b31-cef6d414992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:10.054731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea2e1c-9f65-46a0-af50-a3ed67d6799a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:10.057756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-02ea2e1c-9f65-46a0-af50-a3ed67d6799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:10.064386 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 902/1821] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:13:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:10.090244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea2e1c-9f65-46a0-af50-a3ed67d6799a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:10.111228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:10.112133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:10.112414 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:10.112860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] PATH_INFO: `/v3/projects/4bd3e45290f54334ae3d42fcfa8dd19d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:10.114648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd3e45290f54334ae3d42fcfa8dd19d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:10.119382 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:10.266872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd3e45290f54334ae3d42fcfa8dd19d', 'request_id': 'req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:10.273906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd3e45290f54334ae3d42fcfa8dd19d', 'request_id': 'req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:10.294070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd3e45290f54334ae3d42fcfa8dd19d', 'request_id': 'req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:10.302331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:10.311273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] The token cache is being invalidate because project 4bd3e45290f54334ae3d42fcfa8dd19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:10.313686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:10.316040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:10.318336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 920/1822] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:10 2022] DELETE /identity/v3/projects/4bd3e45290f54334ae3d42fcfa8dd19d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:10.323289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ffa8f-9a03-40ac-8ca6-49904b7df92c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:10.323586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ffa8f-9a03-40ac-8ca6-49904b7df92c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:10.323865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ffa8f-9a03-40ac-8ca6-49904b7df92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:10.377424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-777ffa8f-9a03-40ac-8ca6-49904b7df92c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:10.381537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-777ffa8f-9a03-40ac-8ca6-49904b7df92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:10.403650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:10.405401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:10.620102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 903/1823] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:10.620102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad386-0f41-4380-b093-4978a43620ed None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:10.620102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad386-0f41-4380-b093-4978a43620ed None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:10.620102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad386-0f41-4380-b093-4978a43620ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:10.728488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd529a7a-71f7-47f7-8b2d-99a9915aeaa7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:10.751494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-116ad386-0f41-4380-b093-4978a43620ed None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:10.752775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-116ad386-0f41-4380-b093-4978a43620ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:10.754017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbab178-d0d3-41bd-800d-7f9c41fc4677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:10.756122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbab178-d0d3-41bd-800d-7f9c41fc4677 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:10.758490 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbab178-d0d3-41bd-800d-7f9c41fc4677 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:10.759035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbab178-d0d3-41bd-800d-7f9c41fc4677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:10.762562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6dbab178-d0d3-41bd-800d-7f9c41fc4677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:10.779586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 904/1824] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:10.790356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbab178-d0d3-41bd-800d-7f9c41fc4677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:10.796386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbab178-d0d3-41bd-800d-7f9c41fc4677 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:10.803589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ad386-0f41-4380-b093-4978a43620ed None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:10.824206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ad386-0f41-4380-b093-4978a43620ed None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:10.839129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 921/1825] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:10.872468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d553e-d77b-4bd4-9ac3-a6cdd7c9bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:10.873327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d553e-d77b-4bd4-9ac3-a6cdd7c9bc6c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:10.877105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d553e-d77b-4bd4-9ac3-a6cdd7c9bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:10.878357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d553e-d77b-4bd4-9ac3-a6cdd7c9bc6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:10.881408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d553e-d77b-4bd4-9ac3-a6cdd7c9bc6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:10.883880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d553e-d77b-4bd4-9ac3-a6cdd7c9bc6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:10.892159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d553e-d77b-4bd4-9ac3-a6cdd7c9bc6c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:10.982027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 905/1826] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:13:10.987222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbab178-d0d3-41bd-800d-7f9c41fc4677 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:11.010532 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbab178-d0d3-41bd-800d-7f9c41fc4677 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:11.032735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be95ca-8525-4b23-a063-a3a60f5ff713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:11.035882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be95ca-8525-4b23-a063-a3a60f5ff713 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:11.037848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be95ca-8525-4b23-a063-a3a60f5ff713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:11.038623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be95ca-8525-4b23-a063-a3a60f5ff713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:11.040047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be95ca-8525-4b23-a063-a3a60f5ff713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:11.047616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be95ca-8525-4b23-a063-a3a60f5ff713 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:11.165670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 922/1827] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:10 2022] POST /identity/v3/projects => generated 399 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:11.170866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d553e-d77b-4bd4-9ac3-a6cdd7c9bc6c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:11.229667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d553e-d77b-4bd4-9ac3-a6cdd7c9bc6c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:11.433089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47fc6b-f3b5-48b6-8d44-982b169a947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:11.433856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47fc6b-f3b5-48b6-8d44-982b169a947d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:11.434139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47fc6b-f3b5-48b6-8d44-982b169a947d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:11.434415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47fc6b-f3b5-48b6-8d44-982b169a947d admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:11.444491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47fc6b-f3b5-48b6-8d44-982b169a947d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:11.454827 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47fc6b-f3b5-48b6-8d44-982b169a947d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:11.525967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 906/1828] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:11 2022] POST /identity/v3/users => generated 300 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:11.530568 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be95ca-8525-4b23-a063-a3a60f5ff713 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:11.561125 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be95ca-8525-4b23-a063-a3a60f5ff713 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:11.588985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b2688-03f9-433a-8a42-f5fdeea6dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:11.589954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2688-03f9-433a-8a42-f5fdeea6dd6d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:11.590381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2688-03f9-433a-8a42-f5fdeea6dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:11.590727 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2688-03f9-433a-8a42-f5fdeea6dd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:11.591399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b2688-03f9-433a-8a42-f5fdeea6dd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:11.593081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b2688-03f9-433a-8a42-f5fdeea6dd6d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:11.647824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 923/1829] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:11.649154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47fc6b-f3b5-48b6-8d44-982b169a947d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:11.654828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:11.666748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47fc6b-f3b5-48b6-8d44-982b169a947d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:11.690119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67eca9-fe68-4d0c-9eba-47225eaee0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:11.690826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67eca9-fe68-4d0c-9eba-47225eaee0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:11.691134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67eca9-fe68-4d0c-9eba-47225eaee0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:11.691386 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67eca9-fe68-4d0c-9eba-47225eaee0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:11.692140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67eca9-fe68-4d0c-9eba-47225eaee0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:11.699149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67eca9-fe68-4d0c-9eba-47225eaee0bb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:11.727853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 907/1830] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:11.732547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b2688-03f9-433a-8a42-f5fdeea6dd6d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:11.761605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b2688-03f9-433a-8a42-f5fdeea6dd6d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:11.768800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1420a-d6f9-48a8-aa8e-e73bc5b22632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:11.770729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1420a-d6f9-48a8-aa8e-e73bc5b22632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:11.771467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1420a-d6f9-48a8-aa8e-e73bc5b22632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:11.772054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1420a-d6f9-48a8-aa8e-e73bc5b22632 admin admin] PATH_INFO: `/v3/projects/bd3727270ccc421089895214d05279ce/users/62f8a28bb86e44abb8c51904c14f42e8/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:11.834391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1420a-d6f9-48a8-aa8e-e73bc5b22632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3727270ccc421089895214d05279ce, user_id=62f8a28bb86e44abb8c51904c14f42e8, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:11.837387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1420a-d6f9-48a8-aa8e-e73bc5b22632 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:11.856567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 924/1831] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:11 2022] PUT /identity/v3/projects/bd3727270ccc421089895214d05279ce/users/62f8a28bb86e44abb8c51904c14f42e8/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:11.867401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95486a-8237-46bc-ac4a-0b9b7f1ebb1f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:11.870366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95486a-8237-46bc-ac4a-0b9b7f1ebb1f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:11.870785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95486a-8237-46bc-ac4a-0b9b7f1ebb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:11.996882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1420a-d6f9-48a8-aa8e-e73bc5b22632 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:12.000109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f0a1420a-d6f9-48a8-aa8e-e73bc5b22632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:12.012161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-eb95486a-8237-46bc-ac4a-0b9b7f1ebb1f None None] MFA Rules not processed for user `62f8a28bb86e44abb8c51904c14f42e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:12.014215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eb95486a-8237-46bc-ac4a-0b9b7f1ebb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:12.187828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 908/1832] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:12.189034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95486a-8237-46bc-ac4a-0b9b7f1ebb1f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:12.256958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1420a-d6f9-48a8-aa8e-e73bc5b22632 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:12.273267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:12.274253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:12.274607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:12.275729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] PATH_INFO: `/v3/projects/7d4ffe1a58e44bafb1a54de3e5c84cee` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:12.279559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4ffe1a58e44bafb1a54de3e5c84cee)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:12.282947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:12.410179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95486a-8237-46bc-ac4a-0b9b7f1ebb1f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:12.414370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:12.427445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd7bdb-922f-4511-bb66-d5bcbfa8665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:12.432186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7bdb-922f-4511-bb66-d5bcbfa8665d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:12.432747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7bdb-922f-4511-bb66-d5bcbfa8665d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:12.433244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7bdb-922f-4511-bb66-d5bcbfa8665d admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:12.439428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd7bdb-922f-4511-bb66-d5bcbfa8665d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:12.445624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd7bdb-922f-4511-bb66-d5bcbfa8665d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:12.446259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4ffe1a58e44bafb1a54de3e5c84cee', 'request_id': 'req-3a693028-9c4a-4a75-bd07-c96f1124f727'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:12.458722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4ffe1a58e44bafb1a54de3e5c84cee', 'request_id': 'req-3a693028-9c4a-4a75-bd07-c96f1124f727'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:12.476014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4ffe1a58e44bafb1a54de3e5c84cee', 'request_id': 'req-3a693028-9c4a-4a75-bd07-c96f1124f727'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:12.518221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] The token cache is being invalidate because project 7d4ffe1a58e44bafb1a54de3e5c84cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:12.518577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:12.519236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:12.521135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 925/1833] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:11 2022] DELETE /identity/v3/projects/7d4ffe1a58e44bafb1a54de3e5c84cee => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:12.524998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:12.527669 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:12.534066 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 909/1834] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:12 2022] POST /identity/v3/projects => generated 399 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:12.542898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd7bdb-922f-4511-bb66-d5bcbfa8665d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:12.548674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-98bd7bdb-922f-4511-bb66-d5bcbfa8665d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:12.629933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a693028-9c4a-4a75-bd07-c96f1124f727 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:12.661315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd7bdb-922f-4511-bb66-d5bcbfa8665d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:12.667284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16cda6-8155-4dbe-964d-3e9284961bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:12.668089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cda6-8155-4dbe-964d-3e9284961bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:12.668373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cda6-8155-4dbe-964d-3e9284961bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:12.668750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cda6-8155-4dbe-964d-3e9284961bfd admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:12.669498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16cda6-8155-4dbe-964d-3e9284961bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:12.671999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16cda6-8155-4dbe-964d-3e9284961bfd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:12.685093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:12.704009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 910/1835] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:12 2022] POST /identity/v3/users => generated 306 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:12.710373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16cda6-8155-4dbe-964d-3e9284961bfd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:12.728028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16cda6-8155-4dbe-964d-3e9284961bfd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:12.729534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:12.730426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:12.730836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:12.731113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] PATH_INFO: `/v3/users/d861b7b4e17d4304bb89e86a9e5911db` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:12.732379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d861b7b4e17d4304bb89e86a9e5911db)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:12.733750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9535c-22a6-4dc2-b510-364c124a26ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:12.734395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:12.734516 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9535c-22a6-4dc2-b510-364c124a26ae admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:12.734945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9535c-22a6-4dc2-b510-364c124a26ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:12.736158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9535c-22a6-4dc2-b510-364c124a26ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:12.736158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9535c-22a6-4dc2-b510-364c124a26ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:12.738196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9535c-22a6-4dc2-b510-364c124a26ae admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:12.758897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 911/1836] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:12.760795 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9535c-22a6-4dc2-b510-364c124a26ae admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:12.776226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9535c-22a6-4dc2-b510-364c124a26ae admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:12.792211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660f8d6-f4fa-440a-b4c1-78c2609feb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:12.794244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f8d6-f4fa-440a-b4c1-78c2609feb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:12.794537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f8d6-f4fa-440a-b4c1-78c2609feb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:12.794818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f8d6-f4fa-440a-b4c1-78c2609feb38 admin admin] PATH_INFO: `/v3/projects/b9930bee7c3441a5a342ed379ffa07da/users/cc0edbc97ab8486fa37af18dc5f8046c/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:12.808029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd861b7b4e17d4304bb89e86a9e5911db'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:12.820037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660f8d6-f4fa-440a-b4c1-78c2609feb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9930bee7c3441a5a342ed379ffa07da, user_id=cc0edbc97ab8486fa37af18dc5f8046c, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:12.821658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd861b7b4e17d4304bb89e86a9e5911db'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:12.822662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd861b7b4e17d4304bb89e86a9e5911db'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:12.823722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660f8d6-f4fa-440a-b4c1-78c2609feb38 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:12.835046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd861b7b4e17d4304bb89e86a9e5911db'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:12.835927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd861b7b4e17d4304bb89e86a9e5911db'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:12.843630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:12.844469 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 912/1837] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:12 2022] PUT /identity/v3/projects/b9930bee7c3441a5a342ed379ffa07da/users/cc0edbc97ab8486fa37af18dc5f8046c/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:12.849351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660f8d6-f4fa-440a-b4c1-78c2609feb38 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:12.852968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3660f8d6-f4fa-440a-b4c1-78c2609feb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:12.871198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 926/1838] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:12 2022] DELETE /identity/v3/users/d861b7b4e17d4304bb89e86a9e5911db => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:12.944964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660f8d6-f4fa-440a-b4c1-78c2609feb38 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:13.018039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68235a-c5fb-4533-ac3b-3c2904834068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:13.018736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68235a-c5fb-4533-ac3b-3c2904834068 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:13.018982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68235a-c5fb-4533-ac3b-3c2904834068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:13.019262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68235a-c5fb-4533-ac3b-3c2904834068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:13.019991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68235a-c5fb-4533-ac3b-3c2904834068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:13.021654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68235a-c5fb-4533-ac3b-3c2904834068 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:13.033562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 913/1839] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:13.038210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:13.048863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec56917-e73d-4043-a1c7-e27f3748993f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:13.056705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28674ef-51e3-472a-8120-2fc7a2a5f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:13.057695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28674ef-51e3-472a-8120-2fc7a2a5f654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:13.057978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28674ef-51e3-472a-8120-2fc7a2a5f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:13.058257 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28674ef-51e3-472a-8120-2fc7a2a5f654 admin admin] PATH_INFO: `/v3/projects/b9930bee7c3441a5a342ed379ffa07da/users/cc0edbc97ab8486fa37af18dc5f8046c/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:13.060482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28674ef-51e3-472a-8120-2fc7a2a5f654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9930bee7c3441a5a342ed379ffa07da, user_id=cc0edbc97ab8486fa37af18dc5f8046c, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:13.063898 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28674ef-51e3-472a-8120-2fc7a2a5f654 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:13.076482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 927/1840] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:13 2022] PUT /identity/v3/projects/b9930bee7c3441a5a342ed379ffa07da/users/cc0edbc97ab8486fa37af18dc5f8046c/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:13.088081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d539efa-cb10-4c90-a5b5-02164c9adecc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:13.088816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d539efa-cb10-4c90-a5b5-02164c9adecc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:13.090050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d539efa-cb10-4c90-a5b5-02164c9adecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:13.122573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2d539efa-cb10-4c90-a5b5-02164c9adecc None None] MFA Rules not processed for user `cc0edbc97ab8486fa37af18dc5f8046c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:13.124048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2d539efa-cb10-4c90-a5b5-02164c9adecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:13.197933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:13.222735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 914/1841] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:13.233342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28674ef-51e3-472a-8120-2fc7a2a5f654 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:13.235145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e28674ef-51e3-472a-8120-2fc7a2a5f654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:13.316069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28674ef-51e3-472a-8120-2fc7a2a5f654 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:13.327555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7bf9e-5eb7-4fb4-a41a-7731bd48fe0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:13.329478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7bf9e-5eb7-4fb4-a41a-7731bd48fe0d service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:13.329478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7bf9e-5eb7-4fb4-a41a-7731bd48fe0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:13.329478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7bf9e-5eb7-4fb4-a41a-7731bd48fe0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:13.340002 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7bf9e-5eb7-4fb4-a41a-7731bd48fe0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:13.341522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7bf9e-5eb7-4fb4-a41a-7731bd48fe0d service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:13.353625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 928/1842] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:13.356709 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d539efa-cb10-4c90-a5b5-02164c9adecc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:13.358663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2d539efa-cb10-4c90-a5b5-02164c9adecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:13.435209 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d539efa-cb10-4c90-a5b5-02164c9adecc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:13.441322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:13.443165 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:13.443508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:13.443849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] PATH_INFO: `/v3/projects/084d897600d54984b67ade3a9d9bce3a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:13.445139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=084d897600d54984b67ade3a9d9bce3a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:13.447758 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:13.458403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7bf9e-5eb7-4fb4-a41a-7731bd48fe0d service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:13.460024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3ae7bf9e-5eb7-4fb4-a41a-7731bd48fe0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:13.478548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7bf9e-5eb7-4fb4-a41a-7731bd48fe0d service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:13.484464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52afc9-7519-4883-8400-bf53c86dfc9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:13.485872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52afc9-7519-4883-8400-bf53c86dfc9a service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:13.486217 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52afc9-7519-4883-8400-bf53c86dfc9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:13.486509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52afc9-7519-4883-8400-bf53c86dfc9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:13.489172 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ad52afc9-7519-4883-8400-bf53c86dfc9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:13.516609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084d897600d54984b67ade3a9d9bce3a', 'request_id': 'req-addadc11-a73d-4f3b-8969-89111a87fc3a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:13.523597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084d897600d54984b67ade3a9d9bce3a', 'request_id': 'req-addadc11-a73d-4f3b-8969-89111a87fc3a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:13.537277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084d897600d54984b67ade3a9d9bce3a', 'request_id': 'req-addadc11-a73d-4f3b-8969-89111a87fc3a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:13.553673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] The token cache is being invalidate because project 084d897600d54984b67ade3a9d9bce3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:13.553865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:13.554499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:13.556781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 915/1843] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:13 2022] DELETE /identity/v3/projects/084d897600d54984b67ade3a9d9bce3a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:13.560437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:13.564127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:13.585744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52afc9-7519-4883-8400-bf53c86dfc9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:13.587496 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52afc9-7519-4883-8400-bf53c86dfc9a service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:13.600473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 929/1844] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:13.798368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addadc11-a73d-4f3b-8969-89111a87fc3a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:13.804573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:13.805655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:13.805941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:13.806217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] PATH_INFO: `/v3/users/80b475f40d9a46b58d93b1b6c0410403` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:13.807563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80b475f40d9a46b58d93b1b6c0410403)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:13.810007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:13.839856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:13.869493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80b475f40d9a46b58d93b1b6c0410403'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:13.879893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80b475f40d9a46b58d93b1b6c0410403'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:13.880808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80b475f40d9a46b58d93b1b6c0410403'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:13.895150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80b475f40d9a46b58d93b1b6c0410403'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:13.926631 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-74b07ac2-90f1-40b5-8ed8-471782f2f6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80b475f40d9a46b58d93b1b6c0410403'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:13.946335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 916/1845] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:13 2022] DELETE /identity/v3/users/80b475f40d9a46b58d93b1b6c0410403 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:14.672027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52afc9-7519-4883-8400-bf53c86dfc9a service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:14.683676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52afc9-7519-4883-8400-bf53c86dfc9a service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:14.760956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:14.761910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:14.762225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:14.762490 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] PATH_INFO: `/v3/projects/5a62085fa12c4aaaad10d19ea42b196d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:14.763817 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a62085fa12c4aaaad10d19ea42b196d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:14.765832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:14.800012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:14.833867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a62085fa12c4aaaad10d19ea42b196d', 'request_id': 'req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:14.840836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a62085fa12c4aaaad10d19ea42b196d', 'request_id': 'req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:14.849863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a62085fa12c4aaaad10d19ea42b196d', 'request_id': 'req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:14.862060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] The token cache is being invalidate because project 5a62085fa12c4aaaad10d19ea42b196d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:14.862350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:14.862987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f32ad506-5ef9-494d-b377-6ac1ba84ed4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:14.864645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 930/1846] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:14 2022] DELETE /identity/v3/projects/5a62085fa12c4aaaad10d19ea42b196d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:14.870675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e643-b03f-4d86-99dc-c93baaf3fd87 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:14.871160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e643-b03f-4d86-99dc-c93baaf3fd87 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:14.871250 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e643-b03f-4d86-99dc-c93baaf3fd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:14.890834 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b608e643-b03f-4d86-99dc-c93baaf3fd87 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:14.892237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b608e643-b03f-4d86-99dc-c93baaf3fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:14.993831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 917/1847] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:15.003769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f49da0-13ab-4352-b3df-20e96971db2a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.004059 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f49da0-13ab-4352-b3df-20e96971db2a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.004427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f49da0-13ab-4352-b3df-20e96971db2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.027663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e7f49da0-13ab-4352-b3df-20e96971db2a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:15.028944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e7f49da0-13ab-4352-b3df-20e96971db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:15.037581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 931/1848] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:15.042314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608e643-b03f-4d86-99dc-c93baaf3fd87 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.052798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608e643-b03f-4d86-99dc-c93baaf3fd87 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.057864 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d84c9c-6219-4dd5-9703-001416cc7f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.058519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d84c9c-6219-4dd5-9703-001416cc7f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.058805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d84c9c-6219-4dd5-9703-001416cc7f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.059084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d84c9c-6219-4dd5-9703-001416cc7f83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.059845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d84c9c-6219-4dd5-9703-001416cc7f83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:15.060152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d84c9c-6219-4dd5-9703-001416cc7f83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.061791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d84c9c-6219-4dd5-9703-001416cc7f83 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.080280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 918/1849] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:13:15.081992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f49da0-13ab-4352-b3df-20e96971db2a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.092944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f49da0-13ab-4352-b3df-20e96971db2a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.100229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d52fe-d074-41e7-b0af-634420ee4e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.101122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d52fe-d074-41e7-b0af-634420ee4e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.101548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d52fe-d074-41e7-b0af-634420ee4e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.101888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d52fe-d074-41e7-b0af-634420ee4e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.102725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d52fe-d074-41e7-b0af-634420ee4e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.105005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d52fe-d074-41e7-b0af-634420ee4e2f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.169458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 932/1850] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:15 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:15.171184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d84c9c-6219-4dd5-9703-001416cc7f83 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.189571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d84c9c-6219-4dd5-9703-001416cc7f83 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.283019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573ba8-6264-43a7-adb1-3b9bb388e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.283910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573ba8-6264-43a7-adb1-3b9bb388e58e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.284233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573ba8-6264-43a7-adb1-3b9bb388e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.284554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573ba8-6264-43a7-adb1-3b9bb388e58e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.285468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e573ba8-6264-43a7-adb1-3b9bb388e58e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.288357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e573ba8-6264-43a7-adb1-3b9bb388e58e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.312742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 919/1851] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:15 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:15.317423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d52fe-d074-41e7-b0af-634420ee4e2f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.328912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d52fe-d074-41e7-b0af-634420ee4e2f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.335085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cf823-7885-4849-a69c-50b383c835a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.336457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cf823-7885-4849-a69c-50b383c835a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.336741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cf823-7885-4849-a69c-50b383c835a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.337016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cf823-7885-4849-a69c-50b383c835a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.338564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cf823-7885-4849-a69c-50b383c835a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.340431 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cf823-7885-4849-a69c-50b383c835a8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.354657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 933/1852] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:15.356076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573ba8-6264-43a7-adb1-3b9bb388e58e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.367626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573ba8-6264-43a7-adb1-3b9bb388e58e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.372687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23964877-2892-4a99-a13d-d80d4d715ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.373398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964877-2892-4a99-a13d-d80d4d715ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.373684 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964877-2892-4a99-a13d-d80d4d715ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.373961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964877-2892-4a99-a13d-d80d4d715ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.374709 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23964877-2892-4a99-a13d-d80d4d715ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.376640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23964877-2892-4a99-a13d-d80d4d715ad5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.388789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 920/1853] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:15.393874 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cf823-7885-4849-a69c-50b383c835a8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.405130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cf823-7885-4849-a69c-50b383c835a8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.410020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2db93-ff9f-4514-a95b-4d5b08f46b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.410920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2db93-ff9f-4514-a95b-4d5b08f46b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.411193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2db93-ff9f-4514-a95b-4d5b08f46b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.411524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2db93-ff9f-4514-a95b-4d5b08f46b2e admin admin] PATH_INFO: `/v3/projects/bc8d1eb8f31b4b5a81c18ae8d1296039/users/ee6b046930284286be12ce0758d9c276/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.436970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2db93-ff9f-4514-a95b-4d5b08f46b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8d1eb8f31b4b5a81c18ae8d1296039, user_id=ee6b046930284286be12ce0758d9c276, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.448988 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2db93-ff9f-4514-a95b-4d5b08f46b2e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.457836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 934/1854] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:15 2022] PUT /identity/v3/projects/bc8d1eb8f31b4b5a81c18ae8d1296039/users/ee6b046930284286be12ce0758d9c276/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:15.470073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c5ca5-719b-47f0-842f-d188a2f8e404 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.470346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c5ca5-719b-47f0-842f-d188a2f8e404 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.470622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c5ca5-719b-47f0-842f-d188a2f8e404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.478316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:15.505768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b35c5ca5-719b-47f0-842f-d188a2f8e404 None None] MFA Rules not processed for user `ee6b046930284286be12ce0758d9c276`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:15.507158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b35c5ca5-719b-47f0-842f-d188a2f8e404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:15.574574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 921/1855] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:15.579977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2db93-ff9f-4514-a95b-4d5b08f46b2e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.649196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2db93-ff9f-4514-a95b-4d5b08f46b2e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.654351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ddea2-8f6f-46ce-acb4-fb33c9531a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.655018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ddea2-8f6f-46ce-acb4-fb33c9531a7b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.655299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ddea2-8f6f-46ce-acb4-fb33c9531a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.655570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ddea2-8f6f-46ce-acb4-fb33c9531a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.656327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ddea2-8f6f-46ce-acb4-fb33c9531a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.658557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ddea2-8f6f-46ce-acb4-fb33c9531a7b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.687614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 935/1856] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:15 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:15.691663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c5ca5-719b-47f0-842f-d188a2f8e404 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.704053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c5ca5-719b-47f0-842f-d188a2f8e404 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.765012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffc13a-1708-4ce9-9b2b-a182fefae6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.765800 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc13a-1708-4ce9-9b2b-a182fefae6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.766077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc13a-1708-4ce9-9b2b-a182fefae6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.766969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc13a-1708-4ce9-9b2b-a182fefae6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.767094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffc13a-1708-4ce9-9b2b-a182fefae6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.769056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffc13a-1708-4ce9-9b2b-a182fefae6b2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.793473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 922/1857] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:15 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:15.794669 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ddea2-8f6f-46ce-acb4-fb33c9531a7b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.806863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ddea2-8f6f-46ce-acb4-fb33c9531a7b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.813141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a50e3a-08c6-4c2e-8fce-a6781b76f479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.813923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a50e3a-08c6-4c2e-8fce-a6781b76f479 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.814208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a50e3a-08c6-4c2e-8fce-a6781b76f479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.814479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a50e3a-08c6-4c2e-8fce-a6781b76f479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.815233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a50e3a-08c6-4c2e-8fce-a6781b76f479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.816916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a50e3a-08c6-4c2e-8fce-a6781b76f479 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.831436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 936/1858] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:15.835531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffc13a-1708-4ce9-9b2b-a182fefae6b2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.846024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffc13a-1708-4ce9-9b2b-a182fefae6b2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.850902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd13ed-6928-43ec-926a-f0364ecf81f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.851802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd13ed-6928-43ec-926a-f0364ecf81f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.852087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd13ed-6928-43ec-926a-f0364ecf81f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.852367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd13ed-6928-43ec-926a-f0364ecf81f6 admin admin] PATH_INFO: `/v3/projects/41a90fb6709246a1bac3108cc2d73d66/users/938ea0b3aee247de9c9a74f8fad1d3e9/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.868589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd13ed-6928-43ec-926a-f0364ecf81f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a90fb6709246a1bac3108cc2d73d66, user_id=938ea0b3aee247de9c9a74f8fad1d3e9, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.871322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd13ed-6928-43ec-926a-f0364ecf81f6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.885984 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 923/1859] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:15 2022] PUT /identity/v3/projects/41a90fb6709246a1bac3108cc2d73d66/users/938ea0b3aee247de9c9a74f8fad1d3e9/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:15.890038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a50e3a-08c6-4c2e-8fce-a6781b76f479 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:15.900412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a50e3a-08c6-4c2e-8fce-a6781b76f479 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:15.910310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:15.970858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbc702-95db-446a-b7b7-74b481fe04e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:15.971511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc702-95db-446a-b7b7-74b481fe04e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:15.971798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc702-95db-446a-b7b7-74b481fe04e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:15.972076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc702-95db-446a-b7b7-74b481fe04e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:15.972835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbc702-95db-446a-b7b7-74b481fe04e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:15.974555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbc702-95db-446a-b7b7-74b481fe04e9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:15.986128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 937/1860] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:15.990722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd13ed-6928-43ec-926a-f0364ecf81f6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:16.001401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd13ed-6928-43ec-926a-f0364ecf81f6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:16.006441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bb357-9947-4a2d-b25b-492de67ed2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:16.007324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bb357-9947-4a2d-b25b-492de67ed2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:16.007626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bb357-9947-4a2d-b25b-492de67ed2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:16.007904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bb357-9947-4a2d-b25b-492de67ed2ea admin admin] PATH_INFO: `/v3/projects/41a90fb6709246a1bac3108cc2d73d66/users/938ea0b3aee247de9c9a74f8fad1d3e9/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:16.010077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bb357-9947-4a2d-b25b-492de67ed2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a90fb6709246a1bac3108cc2d73d66, user_id=938ea0b3aee247de9c9a74f8fad1d3e9, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:16.012691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bb357-9947-4a2d-b25b-492de67ed2ea admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:16.023299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 924/1861] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:15 2022] PUT /identity/v3/projects/41a90fb6709246a1bac3108cc2d73d66/users/938ea0b3aee247de9c9a74f8fad1d3e9/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:16.034377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba576d-2a72-4d22-8483-c578631669de None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:16.034665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba576d-2a72-4d22-8483-c578631669de None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:16.034944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba576d-2a72-4d22-8483-c578631669de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:16.062165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1eba576d-2a72-4d22-8483-c578631669de None None] MFA Rules not processed for user `938ea0b3aee247de9c9a74f8fad1d3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:16.063479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1eba576d-2a72-4d22-8483-c578631669de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:16.137757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 938/1862] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:16.150538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bb357-9947-4a2d-b25b-492de67ed2ea admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:16.152535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-592bb357-9947-4a2d-b25b-492de67ed2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:16.215205 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:16.222294 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bb357-9947-4a2d-b25b-492de67ed2ea admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:16.226504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd8733-79cc-432d-b325-3cc5987157a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:16.227171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd8733-79cc-432d-b325-3cc5987157a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:16.227440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd8733-79cc-432d-b325-3cc5987157a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:16.227715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd8733-79cc-432d-b325-3cc5987157a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:16.237702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd8733-79cc-432d-b325-3cc5987157a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:16.239180 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd8733-79cc-432d-b325-3cc5987157a7 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:16.251797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 925/1863] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:16.342739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba576d-2a72-4d22-8483-c578631669de None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:16.352934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba576d-2a72-4d22-8483-c578631669de None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:16.356923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfee0f4-e981-4010-b937-25840dadefbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:16.357609 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee0f4-e981-4010-b937-25840dadefbf service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:16.357892 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee0f4-e981-4010-b937-25840dadefbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:16.358171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee0f4-e981-4010-b937-25840dadefbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:16.433153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfee0f4-e981-4010-b937-25840dadefbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:16.434720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfee0f4-e981-4010-b937-25840dadefbf service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:16.445981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 939/1864] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:16.860409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd8733-79cc-432d-b325-3cc5987157a7 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:16.957158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd8733-79cc-432d-b325-3cc5987157a7 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:16.964426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:16.965623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:16.966244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:16.967439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] PATH_INFO: `/v3/users/ee6b046930284286be12ce0758d9c276` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:16.969784 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6b046930284286be12ce0758d9c276)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:16.971982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:17.052292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6b046930284286be12ce0758d9c276'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:17.067104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6b046930284286be12ce0758d9c276'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:17.067921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6b046930284286be12ce0758d9c276'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:17.080446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6b046930284286be12ce0758d9c276'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:17.104404 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6b046930284286be12ce0758d9c276'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:17.133376 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 926/1865] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:16 2022] DELETE /identity/v3/users/ee6b046930284286be12ce0758d9c276 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:17.140377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db398-bbbf-484d-a994-48ac73443934 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:17.140956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db398-bbbf-484d-a994-48ac73443934 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:17.141066 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db398-bbbf-484d-a994-48ac73443934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:17.162816 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-740db398-bbbf-484d-a994-48ac73443934 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:17.164265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-740db398-bbbf-484d-a994-48ac73443934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:17.213293 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:17.300776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 940/1866] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:17.308915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:17.311362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:17.398692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c518-a308-4f73-b045-4c8c65d0b9c7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:17.402427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22bb57-112c-49d2-a93f-9a99c365b366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:17.403086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22bb57-112c-49d2-a93f-9a99c365b366 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:17.403435 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22bb57-112c-49d2-a93f-9a99c365b366 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:17.403626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22bb57-112c-49d2-a93f-9a99c365b366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:17.413148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22bb57-112c-49d2-a93f-9a99c365b366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:17.414638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22bb57-112c-49d2-a93f-9a99c365b366 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:17.426004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 927/1867] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:17.772101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db398-bbbf-484d-a994-48ac73443934 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:17.774242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-740db398-bbbf-484d-a994-48ac73443934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:17.795322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db398-bbbf-484d-a994-48ac73443934 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:17.801899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:17.803034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:17.803398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:17.803756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] PATH_INFO: `/v3/projects/bc8d1eb8f31b4b5a81c18ae8d1296039` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:17.805275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc8d1eb8f31b4b5a81c18ae8d1296039)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:17.807362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:17.895054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8d1eb8f31b4b5a81c18ae8d1296039', 'request_id': 'req-c7d399a2-cb92-4907-8ce4-8810257deafc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:17.903781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8d1eb8f31b4b5a81c18ae8d1296039', 'request_id': 'req-c7d399a2-cb92-4907-8ce4-8810257deafc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:17.912797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8d1eb8f31b4b5a81c18ae8d1296039', 'request_id': 'req-c7d399a2-cb92-4907-8ce4-8810257deafc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:17.948263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] The token cache is being invalidate because project bc8d1eb8f31b4b5a81c18ae8d1296039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:17.948751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:17.950301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:17.952624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 941/1868] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:17 2022] DELETE /identity/v3/projects/bc8d1eb8f31b4b5a81c18ae8d1296039 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:17.957396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22bb57-112c-49d2-a93f-9a99c365b366 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:17.969788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22bb57-112c-49d2-a93f-9a99c365b366 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:17.992209 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:18.065558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:18.067077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:18.067445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:18.068163 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] PATH_INFO: `/v3/users/938ea0b3aee247de9c9a74f8fad1d3e9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:18.069703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=938ea0b3aee247de9c9a74f8fad1d3e9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:18.072407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:18.144692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938ea0b3aee247de9c9a74f8fad1d3e9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:18.154990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938ea0b3aee247de9c9a74f8fad1d3e9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:18.155855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938ea0b3aee247de9c9a74f8fad1d3e9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:18.167624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938ea0b3aee247de9c9a74f8fad1d3e9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:18.194323 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-609ecece-7300-4cb5-a6c9-f1d00d40ffc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938ea0b3aee247de9c9a74f8fad1d3e9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:18.207327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 928/1869] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:17 2022] DELETE /identity/v3/users/938ea0b3aee247de9c9a74f8fad1d3e9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:18.418161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:18.420031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:18.438773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d399a2-cb92-4907-8ce4-8810257deafc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:18.594906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:18.596190 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:18.596190 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:18.596488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] PATH_INFO: `/v3/users/62f8a28bb86e44abb8c51904c14f42e8` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:18.601820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f8a28bb86e44abb8c51904c14f42e8)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:18.604066 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:18.731312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f8a28bb86e44abb8c51904c14f42e8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:18.748478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f8a28bb86e44abb8c51904c14f42e8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:18.749977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f8a28bb86e44abb8c51904c14f42e8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:18.769348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:18.796751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f8a28bb86e44abb8c51904c14f42e8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:18.800213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f8a28bb86e44abb8c51904c14f42e8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:18.838334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 942/1870] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:18 2022] DELETE /identity/v3/users/62f8a28bb86e44abb8c51904c14f42e8 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:18.842895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502de5-ab0a-45d3-b646-47d5569ba39f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:18.843238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502de5-ab0a-45d3-b646-47d5569ba39f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:18.843476 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502de5-ab0a-45d3-b646-47d5569ba39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:18.870641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8b502de5-ab0a-45d3-b646-47d5569ba39f None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:18.872519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8b502de5-ab0a-45d3-b646-47d5569ba39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:18.982971 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 929/1871] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:19.041887 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:19.044009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:19.170473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b502de5-ab0a-45d3-b646-47d5569ba39f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:19.172679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8b502de5-ab0a-45d3-b646-47d5569ba39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:19.198622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b502de5-ab0a-45d3-b646-47d5569ba39f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:19.200639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5b624-96c8-4145-9b23-fd473faa2758 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:19.213420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66202e01-2fe5-446b-a162-060e1ce966ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:19.213420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66202e01-2fe5-446b-a162-060e1ce966ea service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:19.214193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66202e01-2fe5-446b-a162-060e1ce966ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:19.214631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66202e01-2fe5-446b-a162-060e1ce966ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:19.215452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:19.216462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:19.216697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:19.216873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] PATH_INFO: `/v3/projects/41a90fb6709246a1bac3108cc2d73d66` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:19.219874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a90fb6709246a1bac3108cc2d73d66)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:19.223445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:19.241745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66202e01-2fe5-446b-a162-060e1ce966ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:19.244118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66202e01-2fe5-446b-a162-060e1ce966ea service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:19.274241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 943/1872] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:19.295576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:19.330810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a90fb6709246a1bac3108cc2d73d66', 'request_id': 'req-99483d32-7188-4a14-962b-d3fe72dc9ed4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:19.346798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a90fb6709246a1bac3108cc2d73d66', 'request_id': 'req-99483d32-7188-4a14-962b-d3fe72dc9ed4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:19.362440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a90fb6709246a1bac3108cc2d73d66', 'request_id': 'req-99483d32-7188-4a14-962b-d3fe72dc9ed4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:19.378874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] The token cache is being invalidate because project 41a90fb6709246a1bac3108cc2d73d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:19.379510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:19.381918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99483d32-7188-4a14-962b-d3fe72dc9ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:19.383870 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 930/1873] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:19 2022] DELETE /identity/v3/projects/41a90fb6709246a1bac3108cc2d73d66 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:19.392707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752eeb9-0b11-4a2b-9f41-b111a402e036 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:19.393152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752eeb9-0b11-4a2b-9f41-b111a402e036 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:19.393458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752eeb9-0b11-4a2b-9f41-b111a402e036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:19.444313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7752eeb9-0b11-4a2b-9f41-b111a402e036 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:19.454952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7752eeb9-0b11-4a2b-9f41-b111a402e036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:19.608729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 944/1874] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:19.618035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4156b1f-cbea-431b-98c2-2c1ca2ea8832 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:19.618332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4156b1f-cbea-431b-98c2-2c1ca2ea8832 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:19.618624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4156b1f-cbea-431b-98c2-2c1ca2ea8832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:19.718547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b4156b1f-cbea-431b-98c2-2c1ca2ea8832 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:19.720042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b4156b1f-cbea-431b-98c2-2c1ca2ea8832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:19.752286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 931/1875] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:19.752652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752eeb9-0b11-4a2b-9f41-b111a402e036 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:19.768073 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752eeb9-0b11-4a2b-9f41-b111a402e036 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:19.781851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f2ae8-e8a4-44a9-af6c-b52d553f3f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:19.782645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f2ae8-e8a4-44a9-af6c-b52d553f3f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:19.782976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f2ae8-e8a4-44a9-af6c-b52d553f3f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:19.783240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f2ae8-e8a4-44a9-af6c-b52d553f3f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:19.784038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f2ae8-e8a4-44a9-af6c-b52d553f3f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:19.784352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f2ae8-e8a4-44a9-af6c-b52d553f3f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:19.786076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f2ae8-e8a4-44a9-af6c-b52d553f3f46 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:19.824481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4156b1f-cbea-431b-98c2-2c1ca2ea8832 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:19.825464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 945/1876] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:19.839959 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4156b1f-cbea-431b-98c2-2c1ca2ea8832 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:19.850337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae83b8-5bb4-4c28-8dac-6a685f067e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:19.851881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae83b8-5bb4-4c28-8dac-6a685f067e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:19.852707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae83b8-5bb4-4c28-8dac-6a685f067e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:19.853059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae83b8-5bb4-4c28-8dac-6a685f067e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:19.854155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae83b8-5bb4-4c28-8dac-6a685f067e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:19.857725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae83b8-5bb4-4c28-8dac-6a685f067e91 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:19.901377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 932/1877] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:19 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:19.904071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f2ae8-e8a4-44a9-af6c-b52d553f3f46 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:19.919170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f2ae8-e8a4-44a9-af6c-b52d553f3f46 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:20.035488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5034555-d020-4936-a481-11f95ffc05a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:20.036309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034555-d020-4936-a481-11f95ffc05a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:20.037440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034555-d020-4936-a481-11f95ffc05a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:20.037792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034555-d020-4936-a481-11f95ffc05a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:20.038563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5034555-d020-4936-a481-11f95ffc05a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:20.040775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5034555-d020-4936-a481-11f95ffc05a3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:20.057019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:20.077407 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 946/1878] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:19 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:20.080329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae83b8-5bb4-4c28-8dac-6a685f067e91 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:20.091817 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae83b8-5bb4-4c28-8dac-6a685f067e91 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:20.097468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f68197-5434-4dac-9ef6-fdf2bf7f9904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:20.098591 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f68197-5434-4dac-9ef6-fdf2bf7f9904 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:20.098873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f68197-5434-4dac-9ef6-fdf2bf7f9904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:20.099143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f68197-5434-4dac-9ef6-fdf2bf7f9904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:20.100098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f68197-5434-4dac-9ef6-fdf2bf7f9904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:20.102285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f68197-5434-4dac-9ef6-fdf2bf7f9904 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:20.115312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 933/1879] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:20.120536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5034555-d020-4936-a481-11f95ffc05a3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:20.135264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5034555-d020-4936-a481-11f95ffc05a3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:20.140193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf0a47-33de-4faa-8003-eedd9a2eaf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:20.140955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf0a47-33de-4faa-8003-eedd9a2eaf0c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:20.141375 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf0a47-33de-4faa-8003-eedd9a2eaf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:20.142076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf0a47-33de-4faa-8003-eedd9a2eaf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:20.142992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf0a47-33de-4faa-8003-eedd9a2eaf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:20.145144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf0a47-33de-4faa-8003-eedd9a2eaf0c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:20.163221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 947/1880] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:20.164182 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f68197-5434-4dac-9ef6-fdf2bf7f9904 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:20.176450 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f68197-5434-4dac-9ef6-fdf2bf7f9904 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:20.187190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290efef5-bc77-44b8-ad3c-69d8e8b74628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:20.188583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290efef5-bc77-44b8-ad3c-69d8e8b74628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:20.189788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290efef5-bc77-44b8-ad3c-69d8e8b74628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:20.190339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290efef5-bc77-44b8-ad3c-69d8e8b74628 admin admin] PATH_INFO: `/v3/projects/65aa233dd0c444dfb52d78b83426d7e0/users/f83846c53e0e4972bdbca8e14b8267a2/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:20.220641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290efef5-bc77-44b8-ad3c-69d8e8b74628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65aa233dd0c444dfb52d78b83426d7e0, user_id=f83846c53e0e4972bdbca8e14b8267a2, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:20.220882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf0a47-33de-4faa-8003-eedd9a2eaf0c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:20.223226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9aaf0a47-33de-4faa-8003-eedd9a2eaf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:20.224798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290efef5-bc77-44b8-ad3c-69d8e8b74628 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:20.244323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf0a47-33de-4faa-8003-eedd9a2eaf0c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:20.246075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 934/1881] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:20 2022] PUT /identity/v3/projects/65aa233dd0c444dfb52d78b83426d7e0/users/f83846c53e0e4972bdbca8e14b8267a2/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:20.261656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7a4a0-b7d2-4594-9b37-88bfe4ebe5a9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:20.262654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7a4a0-b7d2-4594-9b37-88bfe4ebe5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:20.264119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7a4a0-b7d2-4594-9b37-88bfe4ebe5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:20.322879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8ed7a4a0-b7d2-4594-9b37-88bfe4ebe5a9 None None] MFA Rules not processed for user `f83846c53e0e4972bdbca8e14b8267a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:20.324737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8ed7a4a0-b7d2-4594-9b37-88bfe4ebe5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:20.330809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:20.331705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:20.332031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:20.332246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] PATH_INFO: `/v3/projects/bd3727270ccc421089895214d05279ce` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:20.333500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3727270ccc421089895214d05279ce)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:20.335451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:20.429872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3727270ccc421089895214d05279ce', 'request_id': 'req-dfa4b97c-8273-4f33-b7b2-658f44df9650'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:20.440835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3727270ccc421089895214d05279ce', 'request_id': 'req-dfa4b97c-8273-4f33-b7b2-658f44df9650'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:20.454050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3727270ccc421089895214d05279ce', 'request_id': 'req-dfa4b97c-8273-4f33-b7b2-658f44df9650'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:20.468202 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] The token cache is being invalidate because project bd3727270ccc421089895214d05279ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:20.469380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:20.470376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:20.472959 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 948/1882] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:20 2022] DELETE /identity/v3/projects/bd3727270ccc421089895214d05279ce => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:20.477507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:20.480125 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:20.511444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 935/1883] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:20.526580 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7a4a0-b7d2-4594-9b37-88bfe4ebe5a9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:20.528198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8ed7a4a0-b7d2-4594-9b37-88bfe4ebe5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:20.591468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b97c-8273-4f33-b7b2-658f44df9650 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:20.597378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:20.598280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:20.598394 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:20.598668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:20.598877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] PATH_INFO: `/v3/users/cc0edbc97ab8486fa37af18dc5f8046c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:20.600236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0edbc97ab8486fa37af18dc5f8046c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:20.602367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:20.615690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7a4a0-b7d2-4594-9b37-88bfe4ebe5a9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:20.620885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:20.655358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0edbc97ab8486fa37af18dc5f8046c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:20.663328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0edbc97ab8486fa37af18dc5f8046c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:20.664174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0edbc97ab8486fa37af18dc5f8046c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:20.672002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd29a7-d833-4877-b15b-22f1d533ed0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b74d07fba34715a488539d630b0bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:20.672837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd29a7-d833-4877-b15b-22f1d533ed0c service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:20.673094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0edbc97ab8486fa37af18dc5f8046c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:20.673270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd29a7-d833-4877-b15b-22f1d533ed0c service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:20.673703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd29a7-d833-4877-b15b-22f1d533ed0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:20.673908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0edbc97ab8486fa37af18dc5f8046c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:20.675666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d5fd29a7-d833-4877-b15b-22f1d533ed0c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:20.694347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 949/1884] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:20 2022] DELETE /identity/v3/users/cc0edbc97ab8486fa37af18dc5f8046c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:20.747754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd29a7-d833-4877-b15b-22f1d533ed0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:20.749597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd29a7-d833-4877-b15b-22f1d533ed0c service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:20.761315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 936/1885] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:21.240144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:21.241735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:21.333486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b6d31-d984-491f-8ad6-67db25648faa admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:21.338724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:21.339792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:21.340148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:21.340492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] PATH_INFO: `/v3/projects/b9930bee7c3441a5a342ed379ffa07da` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:21.341993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9930bee7c3441a5a342ed379ffa07da)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:21.344131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:21.396195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9930bee7c3441a5a342ed379ffa07da', 'request_id': 'req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:21.402656 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9930bee7c3441a5a342ed379ffa07da', 'request_id': 'req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:21.411926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9930bee7c3441a5a342ed379ffa07da', 'request_id': 'req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:21.423762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] The token cache is being invalidate because project b9930bee7c3441a5a342ed379ffa07da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:21.424055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:21.424690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b5388ae-b93c-4ee3-9869-f9df6dae47c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:21.426337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 950/1886] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:21 2022] DELETE /identity/v3/projects/b9930bee7c3441a5a342ed379ffa07da => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:21.431440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922e238-0eb0-4591-a93d-3db109370233 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:21.431910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922e238-0eb0-4591-a93d-3db109370233 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:21.432019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922e238-0eb0-4591-a93d-3db109370233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:21.450581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9922e238-0eb0-4591-a93d-3db109370233 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:21.451798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9922e238-0eb0-4591-a93d-3db109370233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:21.516094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 937/1887] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:21.524456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66fc1a-d05b-43fa-a3f9-dea2f955b47c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:21.524987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66fc1a-d05b-43fa-a3f9-dea2f955b47c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:21.525078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66fc1a-d05b-43fa-a3f9-dea2f955b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:21.544618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ee66fc1a-d05b-43fa-a3f9-dea2f955b47c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:21.545914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ee66fc1a-d05b-43fa-a3f9-dea2f955b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:21.556460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 951/1888] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:21.561330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922e238-0eb0-4591-a93d-3db109370233 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:21.575786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922e238-0eb0-4591-a93d-3db109370233 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:21.583127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4d1c2-9f5c-47f8-933f-8dac00b34d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:21.583816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4d1c2-9f5c-47f8-933f-8dac00b34d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:21.584090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4d1c2-9f5c-47f8-933f-8dac00b34d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:21.584370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4d1c2-9f5c-47f8-933f-8dac00b34d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:21.585289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4d1c2-9f5c-47f8-933f-8dac00b34d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:21.585919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4d1c2-9f5c-47f8-933f-8dac00b34d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:21.587986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4d1c2-9f5c-47f8-933f-8dac00b34d78 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:21.618055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66fc1a-d05b-43fa-a3f9-dea2f955b47c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:21.619969 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ee66fc1a-d05b-43fa-a3f9-dea2f955b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:21.629982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 938/1889] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:21.631454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4d1c2-9f5c-47f8-933f-8dac00b34d78 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:21.646092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66fc1a-d05b-43fa-a3f9-dea2f955b47c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:21.646592 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4d1c2-9f5c-47f8-933f-8dac00b34d78 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:21.651702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:21.653034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:21.653569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:21.654603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] PATH_INFO: `/v3/users/0229f60f1b8448799b8356ea661c8801` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:21.654700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57516ee-2495-4077-b8f1-9dc291fda400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:21.656410 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0229f60f1b8448799b8356ea661c8801)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:21.657361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57516ee-2495-4077-b8f1-9dc291fda400 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:21.657645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57516ee-2495-4077-b8f1-9dc291fda400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:21.657922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57516ee-2495-4077-b8f1-9dc291fda400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:21.658626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57516ee-2495-4077-b8f1-9dc291fda400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:21.659666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:21.660732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57516ee-2495-4077-b8f1-9dc291fda400 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:21.677416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:21.715669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 939/1890] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:21 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:21.720352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57516ee-2495-4077-b8f1-9dc291fda400 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:21.740056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0229f60f1b8448799b8356ea661c8801'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:21.750857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:21.751428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0229f60f1b8448799b8356ea661c8801'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:21.752703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0229f60f1b8448799b8356ea661c8801'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:21.765870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0229f60f1b8448799b8356ea661c8801'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:21.768320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-734fcd56-8595-4235-aad1-0a0a4ff6be00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0229f60f1b8448799b8356ea661c8801'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:21.815986 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 952/1891] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:21 2022] DELETE /identity/v3/users/0229f60f1b8448799b8356ea661c8801 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:21.823076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db812-b9f2-4c5f-b296-44f52689e045 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:21.823401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db812-b9f2-4c5f-b296-44f52689e045 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:21.824227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db812-b9f2-4c5f-b296-44f52689e045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:21.861650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ea3db812-b9f2-4c5f-b296-44f52689e045 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:21.862536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ea3db812-b9f2-4c5f-b296-44f52689e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:21.865120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57516ee-2495-4077-b8f1-9dc291fda400 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:21.944079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 953/1892] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:21.951926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3db812-b9f2-4c5f-b296-44f52689e045 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:21.954066 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ea3db812-b9f2-4c5f-b296-44f52689e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:21.991306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169c84a-18b7-426e-98cd-cbec005a8877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:21.992071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c84a-18b7-426e-98cd-cbec005a8877 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:21.992347 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c84a-18b7-426e-98cd-cbec005a8877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:21.992625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c84a-18b7-426e-98cd-cbec005a8877 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:21.993410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169c84a-18b7-426e-98cd-cbec005a8877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:21.995381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169c84a-18b7-426e-98cd-cbec005a8877 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:22.029279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3db812-b9f2-4c5f-b296-44f52689e045 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:22.033257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 940/1893] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:21 2022] POST /identity/v3/users => generated 287 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:22.033631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ba08d-23a0-4574-a10e-4b0986e9e0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:22.034298 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ba08d-23a0-4574-a10e-4b0986e9e0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:22.034562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ba08d-23a0-4574-a10e-4b0986e9e0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:22.035054 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169c84a-18b7-426e-98cd-cbec005a8877 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:22.035492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ba08d-23a0-4574-a10e-4b0986e9e0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:22.037043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2169c84a-18b7-426e-98cd-cbec005a8877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:22.047352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ba08d-23a0-4574-a10e-4b0986e9e0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:22.048977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ba08d-23a0-4574-a10e-4b0986e9e0e0 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:22.050825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169c84a-18b7-426e-98cd-cbec005a8877 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:22.057337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccfd9b-a4a5-45f8-b208-38537cde1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:22.057944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccfd9b-a4a5-45f8-b208-38537cde1b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:22.058309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccfd9b-a4a5-45f8-b208-38537cde1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:22.058657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccfd9b-a4a5-45f8-b208-38537cde1b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:22.059532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccfd9b-a4a5-45f8-b208-38537cde1b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:22.061236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 954/1894] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:22.061922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccfd9b-a4a5-45f8-b208-38537cde1b76 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:22.080921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 941/1895] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:22.081998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ba08d-23a0-4574-a10e-4b0986e9e0e0 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:22.092568 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ba08d-23a0-4574-a10e-4b0986e9e0e0 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:22.105070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65a83d-2441-4ef6-8c54-b32e2ab507d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:22.106498 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65a83d-2441-4ef6-8c54-b32e2ab507d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:22.106498 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65a83d-2441-4ef6-8c54-b32e2ab507d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:22.106851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65a83d-2441-4ef6-8c54-b32e2ab507d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:22.107785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65a83d-2441-4ef6-8c54-b32e2ab507d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:22.110174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65a83d-2441-4ef6-8c54-b32e2ab507d3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:22.146100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 955/1896] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:22.149001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccfd9b-a4a5-45f8-b208-38537cde1b76 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:22.164475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccfd9b-a4a5-45f8-b208-38537cde1b76 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:22.169575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a600d07-373a-43fd-b23e-9951dbab7ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:22.170548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a600d07-373a-43fd-b23e-9951dbab7ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:22.170864 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a600d07-373a-43fd-b23e-9951dbab7ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:22.171270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a600d07-373a-43fd-b23e-9951dbab7ae2 admin admin] PATH_INFO: `/v3/projects/ae79d301b05f46fdbed7ef7e905ba064/users/21edfc7452964ea9a7e4246727e38a55/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:22.188975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a600d07-373a-43fd-b23e-9951dbab7ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae79d301b05f46fdbed7ef7e905ba064, user_id=21edfc7452964ea9a7e4246727e38a55, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:22.191886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a600d07-373a-43fd-b23e-9951dbab7ae2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:22.211550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 942/1897] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:22 2022] PUT /identity/v3/projects/ae79d301b05f46fdbed7ef7e905ba064/users/21edfc7452964ea9a7e4246727e38a55/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:22.217305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd0875-400d-4fd9-baa1-316811cccb3f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:22.218563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd0875-400d-4fd9-baa1-316811cccb3f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:22.219207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd0875-400d-4fd9-baa1-316811cccb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:22.250501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cadd0875-400d-4fd9-baa1-316811cccb3f None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:22.252268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cadd0875-400d-4fd9-baa1-316811cccb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:22.284954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:22.347377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 956/1898] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:22.354249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a600d07-373a-43fd-b23e-9951dbab7ae2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:22.378932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c47b9e-b10f-4309-ad03-a8878720329d None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:22.379406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c47b9e-b10f-4309-ad03-a8878720329d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:22.379756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c47b9e-b10f-4309-ad03-a8878720329d None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:22.381527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 957/1899] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 15:13:22.407038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa67b4-7aed-4d02-9e03-dc6431e219f0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:22.407383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa67b4-7aed-4d02-9e03-dc6431e219f0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:22.407790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa67b4-7aed-4d02-9e03-dc6431e219f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:22.447694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d9fa67b4-7aed-4d02-9e03-dc6431e219f0 None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:22.450201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d9fa67b4-7aed-4d02-9e03-dc6431e219f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:22.478639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a600d07-373a-43fd-b23e-9951dbab7ae2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:22.483186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578aca12-e5f1-443c-ab09-713c0effbb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:22.483713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aca12-e5f1-443c-ab09-713c0effbb54 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:22.483995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aca12-e5f1-443c-ab09-713c0effbb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:22.484276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aca12-e5f1-443c-ab09-713c0effbb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:22.506629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578aca12-e5f1-443c-ab09-713c0effbb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:22.508102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578aca12-e5f1-443c-ab09-713c0effbb54 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:22.534239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 943/1900] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:22.576219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 958/1901] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:22.789494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578aca12-e5f1-443c-ab09-713c0effbb54 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:22.791830 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-578aca12-e5f1-443c-ab09-713c0effbb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:22.842379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578aca12-e5f1-443c-ab09-713c0effbb54 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:22.867123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd1433-5c2e-4097-882a-65d0168ab979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:22.871521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd1433-5c2e-4097-882a-65d0168ab979 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:22.871983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd1433-5c2e-4097-882a-65d0168ab979 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:22.873602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd1433-5c2e-4097-882a-65d0168ab979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:22.900564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd1433-5c2e-4097-882a-65d0168ab979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:22.909677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd1433-5c2e-4097-882a-65d0168ab979 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:22.942775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 944/1902] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:22.994140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa67b4-7aed-4d02-9e03-dc6431e219f0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:22.995788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d9fa67b4-7aed-4d02-9e03-dc6431e219f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:23.033675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa67b4-7aed-4d02-9e03-dc6431e219f0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:23.057283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:23.058354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:23.058730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:23.059058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] PATH_INFO: `/v3/projects/36a63e8cfcf5410495b886fd8462f058` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:23.060523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a63e8cfcf5410495b886fd8462f058)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:23.062936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:23.168909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a63e8cfcf5410495b886fd8462f058', 'request_id': 'req-f239c370-313a-4786-99f7-bdec6586263f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:23.177269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a63e8cfcf5410495b886fd8462f058', 'request_id': 'req-f239c370-313a-4786-99f7-bdec6586263f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:23.187430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a63e8cfcf5410495b886fd8462f058', 'request_id': 'req-f239c370-313a-4786-99f7-bdec6586263f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:23.236844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] The token cache is being invalidate because project 36a63e8cfcf5410495b886fd8462f058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:23.237482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:23.238359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f239c370-313a-4786-99f7-bdec6586263f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:23.240580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 959/1903] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:22 2022] DELETE /identity/v3/projects/36a63e8cfcf5410495b886fd8462f058 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:23.245874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd1433-5c2e-4097-882a-65d0168ab979 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:23.258076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd1433-5c2e-4097-882a-65d0168ab979 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:23.262390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:23.335966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:23.337242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:23.337834 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:23.338231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] PATH_INFO: `/v3/users/249b73c69b844f0ba1066096b3d8fc25` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:23.340096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=249b73c69b844f0ba1066096b3d8fc25)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:23.347465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:23.428602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249b73c69b844f0ba1066096b3d8fc25'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:23.438033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249b73c69b844f0ba1066096b3d8fc25'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:23.439096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249b73c69b844f0ba1066096b3d8fc25'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:23.449127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249b73c69b844f0ba1066096b3d8fc25'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:23.465568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249b73c69b844f0ba1066096b3d8fc25'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:23.473936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 945/1904] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:23 2022] DELETE /identity/v3/users/249b73c69b844f0ba1066096b3d8fc25 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:23.661307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49750d7-d9ef-4f56-8f27-ba23fcec027d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:23.661914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49750d7-d9ef-4f56-8f27-ba23fcec027d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:23.661914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49750d7-d9ef-4f56-8f27-ba23fcec027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:23.691498 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c49750d7-d9ef-4f56-8f27-ba23fcec027d None None] MFA Rules not processed for user `21edfc7452964ea9a7e4246727e38a55`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:23.693471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c49750d7-d9ef-4f56-8f27-ba23fcec027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:23.735063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:23.794027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 960/1905] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:23.799131 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:23.801037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:23.894140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5ca95-1232-41c7-9095-a9971c2ba965 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:23.905658 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beb5fa-e6ca-49ff-b218-5ff536dc848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:23.906382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beb5fa-e6ca-49ff-b218-5ff536dc848b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:23.906832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beb5fa-e6ca-49ff-b218-5ff536dc848b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:23.907180 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beb5fa-e6ca-49ff-b218-5ff536dc848b admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:23.908085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beb5fa-e6ca-49ff-b218-5ff536dc848b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:23.912187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beb5fa-e6ca-49ff-b218-5ff536dc848b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:23.967832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 946/1906] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:23 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:23.968481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49750d7-d9ef-4f56-8f27-ba23fcec027d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.003829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beb5fa-e6ca-49ff-b218-5ff536dc848b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.006694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d7beb5fa-e6ca-49ff-b218-5ff536dc848b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:24.025264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49750d7-d9ef-4f56-8f27-ba23fcec027d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.037408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:24.169058 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beb5fa-e6ca-49ff-b218-5ff536dc848b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.174345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.175217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.175490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.175763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] PATH_INFO: `/v3/projects/34d0f6be3db84803a3855c8f2500b0b8` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.177145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d0f6be3db84803a3855c8f2500b0b8)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.178015 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b443-b6ba-4c79-a7e4-e61d414dda66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.179252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.179731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b443-b6ba-4c79-a7e4-e61d414dda66 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.180118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b443-b6ba-4c79-a7e4-e61d414dda66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.180924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b443-b6ba-4c79-a7e4-e61d414dda66 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.182060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67b443-b6ba-4c79-a7e4-e61d414dda66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.185006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67b443-b6ba-4c79-a7e4-e61d414dda66 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.215322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 961/1907] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:23 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:24.219558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b443-b6ba-4c79-a7e4-e61d414dda66 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.260401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b443-b6ba-4c79-a7e4-e61d414dda66 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.287301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d0f6be3db84803a3855c8f2500b0b8', 'request_id': 'req-4669b5c2-ed8a-41dd-a945-d04d9772f77e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:24.295477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d0f6be3db84803a3855c8f2500b0b8', 'request_id': 'req-4669b5c2-ed8a-41dd-a945-d04d9772f77e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:24.309127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d0f6be3db84803a3855c8f2500b0b8', 'request_id': 'req-4669b5c2-ed8a-41dd-a945-d04d9772f77e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:24.326292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] The token cache is being invalidate because project 34d0f6be3db84803a3855c8f2500b0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:24.326292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:24.327373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4669b5c2-ed8a-41dd-a945-d04d9772f77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:24.331231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 947/1908] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:24 2022] DELETE /identity/v3/projects/34d0f6be3db84803a3855c8f2500b0b8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:24.337103 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de352-e1a4-4381-9869-7e7e7000b9a9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.337588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de352-e1a4-4381-9869-7e7e7000b9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.337906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de352-e1a4-4381-9869-7e7e7000b9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.361806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8d7de352-e1a4-4381-9869-7e7e7000b9a9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:24.363542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8d7de352-e1a4-4381-9869-7e7e7000b9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:24.364715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eccea-a508-41d0-b86d-cb67312bb7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.365615 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eccea-a508-41d0-b86d-cb67312bb7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.365900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eccea-a508-41d0-b86d-cb67312bb7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.366173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eccea-a508-41d0-b86d-cb67312bb7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.366935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eccea-a508-41d0-b86d-cb67312bb7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.368617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eccea-a508-41d0-b86d-cb67312bb7ad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.382731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 962/1909] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:24.383812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eccea-a508-41d0-b86d-cb67312bb7ad admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.384682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 948/1910] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:24.392640 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-630eccea-a508-41d0-b86d-cb67312bb7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:24.393609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b79265-d9fd-4f94-804c-6fd3d16e554c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.393895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b79265-d9fd-4f94-804c-6fd3d16e554c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.394558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b79265-d9fd-4f94-804c-6fd3d16e554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.412118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eccea-a508-41d0-b86d-cb67312bb7ad admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.426256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e2b79265-d9fd-4f94-804c-6fd3d16e554c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:24.428588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e2b79265-d9fd-4f94-804c-6fd3d16e554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:24.435546 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23756c8-ce67-4d3f-9785-7f5fb74c7e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.436616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23756c8-ce67-4d3f-9785-7f5fb74c7e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.436916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23756c8-ce67-4d3f-9785-7f5fb74c7e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.437175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23756c8-ce67-4d3f-9785-7f5fb74c7e69 admin admin] PATH_INFO: `/v3/projects/4a548ad9f071466fb96ba349c919023e/users/f6b653a3725446fca1169f7751234699/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.439040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 949/1911] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:24.443547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b79265-d9fd-4f94-804c-6fd3d16e554c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.458316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23756c8-ce67-4d3f-9785-7f5fb74c7e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a548ad9f071466fb96ba349c919023e, user_id=f6b653a3725446fca1169f7751234699, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.461168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23756c8-ce67-4d3f-9785-7f5fb74c7e69 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.462364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b79265-d9fd-4f94-804c-6fd3d16e554c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.473736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ed31a-26fe-4e6c-b805-ffd2e085e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.473736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ed31a-26fe-4e6c-b805-ffd2e085e69a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.473736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ed31a-26fe-4e6c-b805-ffd2e085e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.473736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ed31a-26fe-4e6c-b805-ffd2e085e69a admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.474335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ed31a-26fe-4e6c-b805-ffd2e085e69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:24.474726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ed31a-26fe-4e6c-b805-ffd2e085e69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.478215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ed31a-26fe-4e6c-b805-ffd2e085e69a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.491551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 963/1912] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:24 2022] PUT /identity/v3/projects/4a548ad9f071466fb96ba349c919023e/users/f6b653a3725446fca1169f7751234699/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:24.495717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23756c8-ce67-4d3f-9785-7f5fb74c7e69 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.503327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 950/1913] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:13:24.507939 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ed31a-26fe-4e6c-b805-ffd2e085e69a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.524679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ed31a-26fe-4e6c-b805-ffd2e085e69a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.540348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:24.583201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23756c8-ce67-4d3f-9785-7f5fb74c7e69 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.588180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d039a9-2dff-4b84-ae22-227cda1bcc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.588887 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d039a9-2dff-4b84-ae22-227cda1bcc69 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.589181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d039a9-2dff-4b84-ae22-227cda1bcc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.589475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d039a9-2dff-4b84-ae22-227cda1bcc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.590203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d039a9-2dff-4b84-ae22-227cda1bcc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.591782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d039a9-2dff-4b84-ae22-227cda1bcc69 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.602775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 964/1914] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:24.606835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d039a9-2dff-4b84-ae22-227cda1bcc69 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.615588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3dd48-486e-4742-bd9e-d31209354ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.616309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3dd48-486e-4742-bd9e-d31209354ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.616655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3dd48-486e-4742-bd9e-d31209354ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.617107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3dd48-486e-4742-bd9e-d31209354ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.617907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3dd48-486e-4742-bd9e-d31209354ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.619049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d039a9-2dff-4b84-ae22-227cda1bcc69 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.619873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3dd48-486e-4742-bd9e-d31209354ca0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.624019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1fb15-73d1-42c4-b240-1b6a3b08c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.625183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1fb15-73d1-42c4-b240-1b6a3b08c8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.625670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1fb15-73d1-42c4-b240-1b6a3b08c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.626149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1fb15-73d1-42c4-b240-1b6a3b08c8e7 admin admin] PATH_INFO: `/v3/projects/4a548ad9f071466fb96ba349c919023e/users/f6b653a3725446fca1169f7751234699/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.628521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1fb15-73d1-42c4-b240-1b6a3b08c8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a548ad9f071466fb96ba349c919023e, user_id=f6b653a3725446fca1169f7751234699, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.631346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1fb15-73d1-42c4-b240-1b6a3b08c8e7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.643543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 965/1915] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:24 2022] PUT /identity/v3/projects/4a548ad9f071466fb96ba349c919023e/users/f6b653a3725446fca1169f7751234699/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:24.645678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:24.662933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 951/1916] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:24 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:24.667110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1fb15-73d1-42c4-b240-1b6a3b08c8e7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.735209 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1fb15-73d1-42c4-b240-1b6a3b08c8e7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.792045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518ed79-f84e-453b-a30d-a46a66fdb992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.792810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518ed79-f84e-453b-a30d-a46a66fdb992 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.793175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518ed79-f84e-453b-a30d-a46a66fdb992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.793545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518ed79-f84e-453b-a30d-a46a66fdb992 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.794314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518ed79-f84e-453b-a30d-a46a66fdb992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.796410 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518ed79-f84e-453b-a30d-a46a66fdb992 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.821741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 966/1917] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:24 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:24.823669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3dd48-486e-4742-bd9e-d31209354ca0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.837631 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3dd48-486e-4742-bd9e-d31209354ca0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.842564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31df9a-c360-43b2-9e48-5398cc195ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.843233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31df9a-c360-43b2-9e48-5398cc195ced admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.843511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31df9a-c360-43b2-9e48-5398cc195ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.844159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31df9a-c360-43b2-9e48-5398cc195ced admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.844966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31df9a-c360-43b2-9e48-5398cc195ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.846615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31df9a-c360-43b2-9e48-5398cc195ced admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.859174 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 952/1918] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:24.863797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518ed79-f84e-453b-a30d-a46a66fdb992 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.874995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518ed79-f84e-453b-a30d-a46a66fdb992 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.882577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab1940-9767-4113-9bcf-4e206a7ff8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.883288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab1940-9767-4113-9bcf-4e206a7ff8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.883556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab1940-9767-4113-9bcf-4e206a7ff8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.883827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab1940-9767-4113-9bcf-4e206a7ff8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.884660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab1940-9767-4113-9bcf-4e206a7ff8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.886313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab1940-9767-4113-9bcf-4e206a7ff8f8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.897599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 967/1919] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:24.902135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31df9a-c360-43b2-9e48-5398cc195ced admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:24.913987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31df9a-c360-43b2-9e48-5398cc195ced admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:24.919180 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692047-6712-4c88-b10d-ce0ab56f133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:24.920119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692047-6712-4c88-b10d-ce0ab56f133d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.920427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692047-6712-4c88-b10d-ce0ab56f133d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.920747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692047-6712-4c88-b10d-ce0ab56f133d admin admin] PATH_INFO: `/v3/projects/5c0e25c90640465385fbc72722002c79/users/ec8b3d2cd36a4010948315104567f80e/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:24.938010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692047-6712-4c88-b10d-ce0ab56f133d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0e25c90640465385fbc72722002c79, user_id=ec8b3d2cd36a4010948315104567f80e, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:24.940655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692047-6712-4c88-b10d-ce0ab56f133d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:24.961431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 953/1920] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:24 2022] PUT /identity/v3/projects/5c0e25c90640465385fbc72722002c79/users/ec8b3d2cd36a4010948315104567f80e/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:24.970610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1b91c-abeb-404d-b4fd-bec57ca710a2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:24.971096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1b91c-abeb-404d-b4fd-bec57ca710a2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:24.971712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1b91c-abeb-404d-b4fd-bec57ca710a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.002246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3ef1b91c-abeb-404d-b4fd-bec57ca710a2 None None] MFA Rules not processed for user `ec8b3d2cd36a4010948315104567f80e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:25.004194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3ef1b91c-abeb-404d-b4fd-bec57ca710a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:25.051016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:25.105243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 968/1921] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:25.107226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692047-6712-4c88-b10d-ce0ab56f133d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:25.186499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692047-6712-4c88-b10d-ce0ab56f133d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:25.193910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039034f8-a28a-424d-8555-ee3efde54b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:25.195559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039034f8-a28a-424d-8555-ee3efde54b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:25.195860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039034f8-a28a-424d-8555-ee3efde54b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:25.196147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039034f8-a28a-424d-8555-ee3efde54b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.196912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039034f8-a28a-424d-8555-ee3efde54b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:25.198969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039034f8-a28a-424d-8555-ee3efde54b19 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:25.241243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 954/1922] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:25 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:25.242590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1b91c-abeb-404d-b4fd-bec57ca710a2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:25.254658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1b91c-abeb-404d-b4fd-bec57ca710a2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:25.331005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8f03d-86e6-4e11-a9f0-7fed99a1e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:25.331694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f03d-86e6-4e11-a9f0-7fed99a1e3bc admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:25.331985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f03d-86e6-4e11-a9f0-7fed99a1e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:25.332441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f03d-86e6-4e11-a9f0-7fed99a1e3bc admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.333244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8f03d-86e6-4e11-a9f0-7fed99a1e3bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:25.335242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8f03d-86e6-4e11-a9f0-7fed99a1e3bc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:25.365795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 969/1923] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:25 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:25.370610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039034f8-a28a-424d-8555-ee3efde54b19 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:25.383394 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039034f8-a28a-424d-8555-ee3efde54b19 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:25.388582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f1073-df6d-47a1-8bc0-4f1c4d5b9ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:25.389586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f1073-df6d-47a1-8bc0-4f1c4d5b9ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:25.389735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f1073-df6d-47a1-8bc0-4f1c4d5b9ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:25.389911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f1073-df6d-47a1-8bc0-4f1c4d5b9ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.391748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f1073-df6d-47a1-8bc0-4f1c4d5b9ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:25.394253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f1073-df6d-47a1-8bc0-4f1c4d5b9ba1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:25.410264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 955/1924] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:25.414606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8f03d-86e6-4e11-a9f0-7fed99a1e3bc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:25.431867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8f03d-86e6-4e11-a9f0-7fed99a1e3bc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:25.436926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6055117-0293-4ebc-99e6-b6a5473852e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:25.438010 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6055117-0293-4ebc-99e6-b6a5473852e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:25.438290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6055117-0293-4ebc-99e6-b6a5473852e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:25.438620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6055117-0293-4ebc-99e6-b6a5473852e9 admin admin] PATH_INFO: `/v3/projects/e2eb6a1976d64adc95efb4ea4e6cc683/users/8860909199054fd3a2861400d8090af5/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.457780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6055117-0293-4ebc-99e6-b6a5473852e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eb6a1976d64adc95efb4ea4e6cc683, user_id=8860909199054fd3a2861400d8090af5, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:25.462093 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6055117-0293-4ebc-99e6-b6a5473852e9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:25.481541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 970/1925] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:25 2022] PUT /identity/v3/projects/e2eb6a1976d64adc95efb4ea4e6cc683/users/8860909199054fd3a2861400d8090af5/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:25.485963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f1073-df6d-47a1-8bc0-4f1c4d5b9ba1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:25.500016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f1073-df6d-47a1-8bc0-4f1c4d5b9ba1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:25.568819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65b507-85d1-410b-b277-adcca40bee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:25.569643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b507-85d1-410b-b277-adcca40bee44 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:25.569990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b507-85d1-410b-b277-adcca40bee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:25.570334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b507-85d1-410b-b277-adcca40bee44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.571237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65b507-85d1-410b-b277-adcca40bee44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:25.572964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65b507-85d1-410b-b277-adcca40bee44 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:25.586335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 956/1926] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:25.590625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6055117-0293-4ebc-99e6-b6a5473852e9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:25.602192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6055117-0293-4ebc-99e6-b6a5473852e9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:25.607220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1397b84-9ea4-4521-9259-29bf5254292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:25.608122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1397b84-9ea4-4521-9259-29bf5254292a admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:25.608405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1397b84-9ea4-4521-9259-29bf5254292a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:25.608680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1397b84-9ea4-4521-9259-29bf5254292a admin admin] PATH_INFO: `/v3/projects/e2eb6a1976d64adc95efb4ea4e6cc683/users/8860909199054fd3a2861400d8090af5/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.611007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1397b84-9ea4-4521-9259-29bf5254292a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eb6a1976d64adc95efb4ea4e6cc683, user_id=8860909199054fd3a2861400d8090af5, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:25.618764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1397b84-9ea4-4521-9259-29bf5254292a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:25.634889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 971/1927] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:25 2022] PUT /identity/v3/projects/e2eb6a1976d64adc95efb4ea4e6cc683/users/8860909199054fd3a2861400d8090af5/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:25.642978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba4188-ed1a-44ce-a4e4-e65dd121da66 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:25.643204 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba4188-ed1a-44ce-a4e4-e65dd121da66 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:25.643529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba4188-ed1a-44ce-a4e4-e65dd121da66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.682269 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ebba4188-ed1a-44ce-a4e4-e65dd121da66 None None] MFA Rules not processed for user `8860909199054fd3a2861400d8090af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:25.683837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a0144-24fd-4bbf-abc2-13ab8ae968f4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:25.684332 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a0144-24fd-4bbf-abc2-13ab8ae968f4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:25.684424 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a0144-24fd-4bbf-abc2-13ab8ae968f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.691924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ebba4188-ed1a-44ce-a4e4-e65dd121da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:25.718005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1a6a0144-24fd-4bbf-abc2-13ab8ae968f4 None None] MFA Rules not processed for user `f6b653a3725446fca1169f7751234699`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:25.719036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1a6a0144-24fd-4bbf-abc2-13ab8ae968f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:25.731399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:25.818370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 957/1928] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:25.829620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba4188-ed1a-44ce-a4e4-e65dd121da66 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:25.831221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ebba4188-ed1a-44ce-a4e4-e65dd121da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:25.842365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 972/1929] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:25.852940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa706c-68aa-443e-b02c-32394cade90d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:25.853497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa706c-68aa-443e-b02c-32394cade90d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:25.853891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa706c-68aa-443e-b02c-32394cade90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.867926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:25.911674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a4fa706c-68aa-443e-b02c-32394cade90d None None] MFA Rules not processed for user `21edfc7452964ea9a7e4246727e38a55`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:25.914716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a4fa706c-68aa-443e-b02c-32394cade90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:25.924187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba4188-ed1a-44ce-a4e4-e65dd121da66 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:25.936764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16aa5eb-e2db-466c-b78d-486a0c58b4d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:25.939117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aa5eb-e2db-466c-b78d-486a0c58b4d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:25.939787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aa5eb-e2db-466c-b78d-486a0c58b4d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:25.941117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aa5eb-e2db-466c-b78d-486a0c58b4d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:25.992102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16aa5eb-e2db-466c-b78d-486a0c58b4d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:25.993791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16aa5eb-e2db-466c-b78d-486a0c58b4d0 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:26.006254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 958/1930] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:26.038521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 973/1931] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:26.187452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16aa5eb-e2db-466c-b78d-486a0c58b4d0 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:26.262697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16aa5eb-e2db-466c-b78d-486a0c58b4d0 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:26.267375 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:26.268402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:26.268681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:26.268956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] PATH_INFO: `/v3/users/ec8b3d2cd36a4010948315104567f80e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:26.270263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8b3d2cd36a4010948315104567f80e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:26.272997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:26.327667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8b3d2cd36a4010948315104567f80e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:26.335720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8b3d2cd36a4010948315104567f80e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:26.336442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8b3d2cd36a4010948315104567f80e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:26.345172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8b3d2cd36a4010948315104567f80e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:26.347823 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:26.366282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8b3d2cd36a4010948315104567f80e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:26.378636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 959/1932] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:26 2022] DELETE /identity/v3/users/ec8b3d2cd36a4010948315104567f80e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:26.385232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791517c-1a10-4892-8b7f-effac48d190a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:26.385800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791517c-1a10-4892-8b7f-effac48d190a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:26.386096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791517c-1a10-4892-8b7f-effac48d190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:26.405958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7791517c-1a10-4892-8b7f-effac48d190a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:26.406701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:26.407409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7791517c-1a10-4892-8b7f-effac48d190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:26.408073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:26.481121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 974/1933] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:26.491751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791517c-1a10-4892-8b7f-effac48d190a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:26.493008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4cf46-4c78-40b5-a92c-44e78b280798 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:26.493140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7791517c-1a10-4892-8b7f-effac48d190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:26.498569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ef692-ccbb-4cc1-8155-b976aa463258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:26.499249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef692-ccbb-4cc1-8155-b976aa463258 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:26.499532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef692-ccbb-4cc1-8155-b976aa463258 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:26.499869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef692-ccbb-4cc1-8155-b976aa463258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:26.502036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f0ef692-ccbb-4cc1-8155-b976aa463258 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:26.567317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791517c-1a10-4892-8b7f-effac48d190a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:26.572473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa054f-f81a-4cb5-b964-21e65fc3746c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:26.573145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa054f-f81a-4cb5-b964-21e65fc3746c service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:26.573775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa054f-f81a-4cb5-b964-21e65fc3746c service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:26.574248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa054f-f81a-4cb5-b964-21e65fc3746c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:26.584872 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ef692-ccbb-4cc1-8155-b976aa463258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:26.585500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa054f-f81a-4cb5-b964-21e65fc3746c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:26.586710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ef692-ccbb-4cc1-8155-b976aa463258 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:26.587013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa054f-f81a-4cb5-b964-21e65fc3746c service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:26.601933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 975/1934] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:26.602424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 960/1935] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:26.999408 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa054f-f81a-4cb5-b964-21e65fc3746c service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:27.001550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c4fa054f-f81a-4cb5-b964-21e65fc3746c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:27.016493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa054f-f81a-4cb5-b964-21e65fc3746c service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:27.025847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:27.035861 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:27.036280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:27.036832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] PATH_INFO: `/v3/projects/5c0e25c90640465385fbc72722002c79` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:27.038303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0e25c90640465385fbc72722002c79)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:27.040267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:27.104178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:27.106119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0e25c90640465385fbc72722002c79', 'request_id': 'req-521d95fa-e046-4160-a76e-33aaf60b38f9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.124550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0e25c90640465385fbc72722002c79', 'request_id': 'req-521d95fa-e046-4160-a76e-33aaf60b38f9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.132282 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0e25c90640465385fbc72722002c79', 'request_id': 'req-521d95fa-e046-4160-a76e-33aaf60b38f9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.144847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] The token cache is being invalidate because project 5c0e25c90640465385fbc72722002c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:27.145181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.146145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.151428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 976/1936] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:26 2022] DELETE /identity/v3/projects/5c0e25c90640465385fbc72722002c79 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:27.151985 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ef692-ccbb-4cc1-8155-b976aa463258 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:27.163854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ef692-ccbb-4cc1-8155-b976aa463258 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:27.240951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:27.241747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:27.242040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:27.242314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] PATH_INFO: `/v3/users/8860909199054fd3a2861400d8090af5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:27.243595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8860909199054fd3a2861400d8090af5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:27.245787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:27.270813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:27.325662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8860909199054fd3a2861400d8090af5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.337541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8860909199054fd3a2861400d8090af5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.338594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8860909199054fd3a2861400d8090af5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.351232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8860909199054fd3a2861400d8090af5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.372958 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8390433c-802f-42a1-b66d-3ef79575650b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8860909199054fd3a2861400d8090af5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.386328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 961/1937] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:27 2022] DELETE /identity/v3/users/8860909199054fd3a2861400d8090af5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:27.826938 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:27.829532 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:27.850608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d95fa-e046-4160-a76e-33aaf60b38f9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:27.929637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:27.930507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:27.930781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:27.931057 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] PATH_INFO: `/v3/projects/e2eb6a1976d64adc95efb4ea4e6cc683` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:27.932283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2eb6a1976d64adc95efb4ea4e6cc683)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:27.934207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:27.983494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2eb6a1976d64adc95efb4ea4e6cc683', 'request_id': 'req-f470bd09-8a19-40e5-9066-29b87aa10a22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.990083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2eb6a1976d64adc95efb4ea4e6cc683', 'request_id': 'req-f470bd09-8a19-40e5-9066-29b87aa10a22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:27.998586 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2eb6a1976d64adc95efb4ea4e6cc683', 'request_id': 'req-f470bd09-8a19-40e5-9066-29b87aa10a22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:28.009838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] The token cache is being invalidate because project e2eb6a1976d64adc95efb4ea4e6cc683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:28.010439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:28.010899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f470bd09-8a19-40e5-9066-29b87aa10a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:28.012834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 977/1938] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:27 2022] DELETE /identity/v3/projects/e2eb6a1976d64adc95efb4ea4e6cc683 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:28.018681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b11a91-6524-4732-907c-6523cd1533b1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.018969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b11a91-6524-4732-907c-6523cd1533b1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.019246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b11a91-6524-4732-907c-6523cd1533b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.038399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d1b11a91-6524-4732-907c-6523cd1533b1 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:28.040112 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1b11a91-6524-4732-907c-6523cd1533b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:28.116285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 962/1939] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:28.124179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee4d6-cd55-4fa1-82d4-e5aa5d5a51a6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.124475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee4d6-cd55-4fa1-82d4-e5aa5d5a51a6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.124785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee4d6-cd55-4fa1-82d4-e5aa5d5a51a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.144278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3b7ee4d6-cd55-4fa1-82d4-e5aa5d5a51a6 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:28.145526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3b7ee4d6-cd55-4fa1-82d4-e5aa5d5a51a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:28.153553 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 978/1940] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:28.158130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b11a91-6524-4732-907c-6523cd1533b1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:28.168658 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b11a91-6524-4732-907c-6523cd1533b1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:28.174153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea27c6-e00a-4bdd-bd8a-a1c4159bdf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:28.174899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea27c6-e00a-4bdd-bd8a-a1c4159bdf9d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.175172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea27c6-e00a-4bdd-bd8a-a1c4159bdf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.175482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea27c6-e00a-4bdd-bd8a-a1c4159bdf9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.176277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea27c6-e00a-4bdd-bd8a-a1c4159bdf9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:28.176586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea27c6-e00a-4bdd-bd8a-a1c4159bdf9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:28.178397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea27c6-e00a-4bdd-bd8a-a1c4159bdf9d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:28.192988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 963/1941] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:28.198859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ee4d6-cd55-4fa1-82d4-e5aa5d5a51a6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:28.209049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ee4d6-cd55-4fa1-82d4-e5aa5d5a51a6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:28.214765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acc868-d2db-4cf0-bab5-43fc7012e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:28.215398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acc868-d2db-4cf0-bab5-43fc7012e975 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.215700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acc868-d2db-4cf0-bab5-43fc7012e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.215962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acc868-d2db-4cf0-bab5-43fc7012e975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.216652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acc868-d2db-4cf0-bab5-43fc7012e975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:28.218735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acc868-d2db-4cf0-bab5-43fc7012e975 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:28.246910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 979/1942] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:28 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:28.251599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea27c6-e00a-4bdd-bd8a-a1c4159bdf9d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:28.262032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea27c6-e00a-4bdd-bd8a-a1c4159bdf9d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:28.329607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff07d0-3c35-41c4-9a55-33e3abfb20eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:28.330198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff07d0-3c35-41c4-9a55-33e3abfb20eb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.330474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff07d0-3c35-41c4-9a55-33e3abfb20eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.330745 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff07d0-3c35-41c4-9a55-33e3abfb20eb admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.331419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff07d0-3c35-41c4-9a55-33e3abfb20eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:28.333382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff07d0-3c35-41c4-9a55-33e3abfb20eb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:28.354368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 964/1943] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:28 2022] POST /identity/v3/users => generated 280 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:28.359885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acc868-d2db-4cf0-bab5-43fc7012e975 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:28.383146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acc868-d2db-4cf0-bab5-43fc7012e975 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:28.396931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d85c7-498b-4438-96b1-9e6e332a4f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:28.397738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d85c7-498b-4438-96b1-9e6e332a4f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.397927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d85c7-498b-4438-96b1-9e6e332a4f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.398203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d85c7-498b-4438-96b1-9e6e332a4f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.398930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d85c7-498b-4438-96b1-9e6e332a4f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:28.400558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d85c7-498b-4438-96b1-9e6e332a4f46 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:28.413977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 980/1944] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:28.417955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff07d0-3c35-41c4-9a55-33e3abfb20eb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:28.430055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff07d0-3c35-41c4-9a55-33e3abfb20eb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:28.434746 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20d027-2cdb-4294-a50f-9634a1cd272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:28.435528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20d027-2cdb-4294-a50f-9634a1cd272c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.435807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20d027-2cdb-4294-a50f-9634a1cd272c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.436075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20d027-2cdb-4294-a50f-9634a1cd272c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.436793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20d027-2cdb-4294-a50f-9634a1cd272c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:28.438571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20d027-2cdb-4294-a50f-9634a1cd272c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:28.452043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 965/1945] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:28.456714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d85c7-498b-4438-96b1-9e6e332a4f46 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:28.467286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d85c7-498b-4438-96b1-9e6e332a4f46 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:28.472050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04f97-0595-47d3-ac05-32c0d0da16da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:28.472940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04f97-0595-47d3-ac05-32c0d0da16da admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.473244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04f97-0595-47d3-ac05-32c0d0da16da admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.473523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04f97-0595-47d3-ac05-32c0d0da16da admin admin] PATH_INFO: `/v3/projects/3c329c43277d4a63ac83233573b99d6d/users/e91918681d834b9fa246573cad92b174/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.491648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc04f97-0595-47d3-ac05-32c0d0da16da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c329c43277d4a63ac83233573b99d6d, user_id=e91918681d834b9fa246573cad92b174, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:28.494543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc04f97-0595-47d3-ac05-32c0d0da16da admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:28.511192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 981/1946] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:28 2022] PUT /identity/v3/projects/3c329c43277d4a63ac83233573b99d6d/users/e91918681d834b9fa246573cad92b174/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:28.522899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62844ab5-9c77-4c03-84f1-fb206ac3fb6d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.523263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62844ab5-9c77-4c03-84f1-fb206ac3fb6d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.523508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62844ab5-9c77-4c03-84f1-fb206ac3fb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.534916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:28.557059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-62844ab5-9c77-4c03-84f1-fb206ac3fb6d None None] MFA Rules not processed for user `e91918681d834b9fa246573cad92b174`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:28.558369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-62844ab5-9c77-4c03-84f1-fb206ac3fb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:28.631467 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 966/1947] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:28 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:28.672686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04f97-0595-47d3-ac05-32c0d0da16da admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:28.674666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fbc04f97-0595-47d3-ac05-32c0d0da16da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:28.680869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:28.737416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04f97-0595-47d3-ac05-32c0d0da16da admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:28.741543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c9845-a6c9-40d9-a4c7-207174a3ce62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:28.742208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9845-a6c9-40d9-a4c7-207174a3ce62 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.742485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9845-a6c9-40d9-a4c7-207174a3ce62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.742754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9845-a6c9-40d9-a4c7-207174a3ce62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.751906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c9845-a6c9-40d9-a4c7-207174a3ce62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:28.753403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c9845-a6c9-40d9-a4c7-207174a3ce62 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:28.763445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 982/1948] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:28 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:28.778502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62844ab5-9c77-4c03-84f1-fb206ac3fb6d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:28.859231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62844ab5-9c77-4c03-84f1-fb206ac3fb6d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:28.865002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:28.865904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.866368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.866532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] PATH_INFO: `/v3/users/e91918681d834b9fa246573cad92b174` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:28.867873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91918681d834b9fa246573cad92b174)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:28.870315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:28.921691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91918681d834b9fa246573cad92b174'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:28.929731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91918681d834b9fa246573cad92b174'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:28.930421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91918681d834b9fa246573cad92b174'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:28.939221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91918681d834b9fa246573cad92b174'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:28.957293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91918681d834b9fa246573cad92b174'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:28.965427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 967/1949] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:28 2022] DELETE /identity/v3/users/e91918681d834b9fa246573cad92b174 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:28.971265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86e096-9e79-4e50-9ded-a0103d17025d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:28.971771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86e096-9e79-4e50-9ded-a0103d17025d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:28.972491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86e096-9e79-4e50-9ded-a0103d17025d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:29.006745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8a86e096-9e79-4e50-9ded-a0103d17025d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:29.008125 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8a86e096-9e79-4e50-9ded-a0103d17025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:29.081646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 983/1950] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:29.093753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:29.095065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:29.119360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:29.196273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81822e-767e-4932-81f0-5885b2f226fd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:29.206886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5231f4-d510-48ba-940f-35e669ce5cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:29.208042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5231f4-d510-48ba-940f-35e669ce5cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:29.208638 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5231f4-d510-48ba-940f-35e669ce5cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:29.209064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5231f4-d510-48ba-940f-35e669ce5cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:29.222753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5231f4-d510-48ba-940f-35e669ce5cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:29.224622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5231f4-d510-48ba-940f-35e669ce5cc1 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:29.244563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 968/1951] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:29.980922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86e096-9e79-4e50-9ded-a0103d17025d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:29.983040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8a86e096-9e79-4e50-9ded-a0103d17025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:30.034128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86e096-9e79-4e50-9ded-a0103d17025d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:30.040524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:30.042022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.044852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.045239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] PATH_INFO: `/v3/projects/3c329c43277d4a63ac83233573b99d6d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.048322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c329c43277d4a63ac83233573b99d6d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:30.050509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:30.119590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c329c43277d4a63ac83233573b99d6d', 'request_id': 'req-b213db56-e539-4130-b04c-fa6c129c25c4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:30.136024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c329c43277d4a63ac83233573b99d6d', 'request_id': 'req-b213db56-e539-4130-b04c-fa6c129c25c4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:30.159364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c329c43277d4a63ac83233573b99d6d', 'request_id': 'req-b213db56-e539-4130-b04c-fa6c129c25c4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:30.193831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5231f4-d510-48ba-940f-35e669ce5cc1 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:30.195262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bc5231f4-d510-48ba-940f-35e669ce5cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:30.212645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5231f4-d510-48ba-940f-35e669ce5cc1 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:30.220691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] The token cache is being invalidate because project 3c329c43277d4a63ac83233573b99d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:30.220952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:30.222832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b213db56-e539-4130-b04c-fa6c129c25c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:30.226458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 984/1952] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:29 2022] DELETE /identity/v3/projects/3c329c43277d4a63ac83233573b99d6d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:30.231513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a324d41-a614-4c37-b3eb-5231f1eb32cf None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.231789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a324d41-a614-4c37-b3eb-5231f1eb32cf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.232069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a324d41-a614-4c37-b3eb-5231f1eb32cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.259920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1a324d41-a614-4c37-b3eb-5231f1eb32cf None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:30.261483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1a324d41-a614-4c37-b3eb-5231f1eb32cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:30.309257 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:30.327255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:30.330322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.330322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.330727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] PATH_INFO: `/v3/users/c9d38b8da5d24712b223080b7f869ca1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.335586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d38b8da5d24712b223080b7f869ca1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:30.337911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:30.377314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 985/1953] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:30.379467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55409c33-20fd-422d-a1a3-6b0a2f76111f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.379857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55409c33-20fd-422d-a1a3-6b0a2f76111f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.380203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55409c33-20fd-422d-a1a3-6b0a2f76111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.403119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-55409c33-20fd-422d-a1a3-6b0a2f76111f None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:30.404804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-55409c33-20fd-422d-a1a3-6b0a2f76111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:30.413059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d38b8da5d24712b223080b7f869ca1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:30.415432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 986/1954] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:30.419726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55409c33-20fd-422d-a1a3-6b0a2f76111f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:30.425753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d38b8da5d24712b223080b7f869ca1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:30.427420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d38b8da5d24712b223080b7f869ca1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:30.430230 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55409c33-20fd-422d-a1a3-6b0a2f76111f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:30.435650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9761dd-193e-4c85-ba79-dd02cb127b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:30.436105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9761dd-193e-4c85-ba79-dd02cb127b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.436381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9761dd-193e-4c85-ba79-dd02cb127b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.436690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9761dd-193e-4c85-ba79-dd02cb127b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.437635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9761dd-193e-4c85-ba79-dd02cb127b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:30.438069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9761dd-193e-4c85-ba79-dd02cb127b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:30.438409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d38b8da5d24712b223080b7f869ca1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:30.439743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9761dd-193e-4c85-ba79-dd02cb127b41 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:30.454977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 987/1955] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:30.462183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9761dd-193e-4c85-ba79-dd02cb127b41 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:30.462673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fbcda6fa-8b5e-4e1d-9823-7f7bc0465e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d38b8da5d24712b223080b7f869ca1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:30.471102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 969/1956] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:30 2022] DELETE /identity/v3/users/c9d38b8da5d24712b223080b7f869ca1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:30.475399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9761dd-193e-4c85-ba79-dd02cb127b41 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:30.475553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b09b-dead-4c2d-a8ec-bbc029b25ab3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.475894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b09b-dead-4c2d-a8ec-bbc029b25ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.476285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b09b-dead-4c2d-a8ec-bbc029b25ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.496450 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f171b09b-dead-4c2d-a8ec-bbc029b25ab3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:30.497820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f171b09b-dead-4c2d-a8ec-bbc029b25ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:30.539677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:30.563123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7b578-70f5-48a8-973a-d63c51895a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:30.563979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7b578-70f5-48a8-973a-d63c51895a79 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.564382 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7b578-70f5-48a8-973a-d63c51895a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.564693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7b578-70f5-48a8-973a-d63c51895a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.565757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7b578-70f5-48a8-973a-d63c51895a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:30.569379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7b578-70f5-48a8-973a-d63c51895a79 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:30.617285 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 988/1957] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:30 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:30.620827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7b578-70f5-48a8-973a-d63c51895a79 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:30.624833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d3e7b578-70f5-48a8-973a-d63c51895a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:30.631979 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 970/1958] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:30.702273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171b09b-dead-4c2d-a8ec-bbc029b25ab3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:30.704849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f171b09b-dead-4c2d-a8ec-bbc029b25ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:30.721391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7b578-70f5-48a8-973a-d63c51895a79 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:30.732255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0d85-ad55-40f7-bab3-bf536d7e426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:30.733248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0d85-ad55-40f7-bab3-bf536d7e426a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.735434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0d85-ad55-40f7-bab3-bf536d7e426a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.735853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0d85-ad55-40f7-bab3-bf536d7e426a admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.737572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0d85-ad55-40f7-bab3-bf536d7e426a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:30.739786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0d85-ad55-40f7-bab3-bf536d7e426a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:30.774558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 989/1959] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:30 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:30.777426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0d85-ad55-40f7-bab3-bf536d7e426a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:30.803122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0d85-ad55-40f7-bab3-bf536d7e426a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:30.813738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171b09b-dead-4c2d-a8ec-bbc029b25ab3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:30.814751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be56c5-5996-4122-90b0-5808cdf7e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:30.815633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be56c5-5996-4122-90b0-5808cdf7e696 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.815923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be56c5-5996-4122-90b0-5808cdf7e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.816203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be56c5-5996-4122-90b0-5808cdf7e696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.816954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be56c5-5996-4122-90b0-5808cdf7e696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:30.820194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be56c5-5996-4122-90b0-5808cdf7e696 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:30.836894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 990/1960] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:30.841723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be56c5-5996-4122-90b0-5808cdf7e696 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:30.856650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be56c5-5996-4122-90b0-5808cdf7e696 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:30.865276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24401d-bad0-42d9-bb99-d6aece06e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:30.866185 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24401d-bad0-42d9-bb99-d6aece06e2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.867235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24401d-bad0-42d9-bb99-d6aece06e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.867727 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24401d-bad0-42d9-bb99-d6aece06e2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.875128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24401d-bad0-42d9-bb99-d6aece06e2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:30.877002 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24401d-bad0-42d9-bb99-d6aece06e2d3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:30.896981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a516392-69e5-4e45-8669-4dada8821b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:30.898097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a516392-69e5-4e45-8669-4dada8821b62 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.899154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 991/1961] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:30.904038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a516392-69e5-4e45-8669-4dada8821b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.904619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a516392-69e5-4e45-8669-4dada8821b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.916523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24401d-bad0-42d9-bb99-d6aece06e2d3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:30.931174 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a516392-69e5-4e45-8669-4dada8821b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:30.931808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:30.932661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a516392-69e5-4e45-8669-4dada8821b62 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:30.946439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 971/1962] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:30.947546 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24401d-bad0-42d9-bb99-d6aece06e2d3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:30.956276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b95601-197d-4924-ba2e-1027b95eab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:30.957381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95601-197d-4924-ba2e-1027b95eab7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:30.957767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95601-197d-4924-ba2e-1027b95eab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:30.958116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95601-197d-4924-ba2e-1027b95eab7d admin admin] PATH_INFO: `/v3/projects/1c125e62e0274bc8a70619863e224867/users/670f52a75dbf466e9ef990d4afa4d948/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:30.976129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b95601-197d-4924-ba2e-1027b95eab7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c125e62e0274bc8a70619863e224867, user_id=670f52a75dbf466e9ef990d4afa4d948, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:30.979146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b95601-197d-4924-ba2e-1027b95eab7d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:30.995803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 992/1963] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:30 2022] PUT /identity/v3/projects/1c125e62e0274bc8a70619863e224867/users/670f52a75dbf466e9ef990d4afa4d948/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:31.006672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bbb78-99ac-49c0-8fc8-e6285a9b3daa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:31.009445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bbb78-99ac-49c0-8fc8-e6285a9b3daa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:31.009978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bbb78-99ac-49c0-8fc8-e6285a9b3daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:31.103748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-238bbb78-99ac-49c0-8fc8-e6285a9b3daa None None] MFA Rules not processed for user `670f52a75dbf466e9ef990d4afa4d948`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:31.107422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-238bbb78-99ac-49c0-8fc8-e6285a9b3daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:31.209067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 972/1964] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:31.214174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b95601-197d-4924-ba2e-1027b95eab7d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:31.311933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b95601-197d-4924-ba2e-1027b95eab7d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:31.317826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96425ba7-3dcc-4601-8f10-bb9dbe597ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:31.318853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425ba7-3dcc-4601-8f10-bb9dbe597ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:31.319726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425ba7-3dcc-4601-8f10-bb9dbe597ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:31.319726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425ba7-3dcc-4601-8f10-bb9dbe597ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:31.320481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96425ba7-3dcc-4601-8f10-bb9dbe597ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:31.322446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96425ba7-3dcc-4601-8f10-bb9dbe597ef0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:31.361564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 993/1965] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:31 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:31.361980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bbb78-99ac-49c0-8fc8-e6285a9b3daa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:31.376793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bbb78-99ac-49c0-8fc8-e6285a9b3daa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:31.402292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:31.448367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48236dcf-1933-4938-b618-d8ad8cf40bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:31.449166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48236dcf-1933-4938-b618-d8ad8cf40bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:31.449562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48236dcf-1933-4938-b618-d8ad8cf40bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:31.449902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48236dcf-1933-4938-b618-d8ad8cf40bdb admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:31.450702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48236dcf-1933-4938-b618-d8ad8cf40bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:31.452705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48236dcf-1933-4938-b618-d8ad8cf40bdb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:31.480139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 973/1966] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:31 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:31.484473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96425ba7-3dcc-4601-8f10-bb9dbe597ef0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:31.495218 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96425ba7-3dcc-4601-8f10-bb9dbe597ef0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:31.500647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962498bc-9ce0-4134-9c8e-23c21ddb2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:31.501237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962498bc-9ce0-4134-9c8e-23c21ddb2a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:31.501532 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962498bc-9ce0-4134-9c8e-23c21ddb2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:31.501807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962498bc-9ce0-4134-9c8e-23c21ddb2a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:31.502811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962498bc-9ce0-4134-9c8e-23c21ddb2a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:31.504152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962498bc-9ce0-4134-9c8e-23c21ddb2a17 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:31.525848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 994/1967] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:31.529348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48236dcf-1933-4938-b618-d8ad8cf40bdb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:31.546147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48236dcf-1933-4938-b618-d8ad8cf40bdb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:31.553974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481905e-8648-48fb-806f-64b5521c6f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:31.555973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481905e-8648-48fb-806f-64b5521c6f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:31.556445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481905e-8648-48fb-806f-64b5521c6f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:31.556899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481905e-8648-48fb-806f-64b5521c6f31 admin admin] PATH_INFO: `/v3/projects/d554b548122b4b4781ba10671633423b/users/cd56cd6a999b44cab2d7e7b409e226e1/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:31.579267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481905e-8648-48fb-806f-64b5521c6f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d554b548122b4b4781ba10671633423b, user_id=cd56cd6a999b44cab2d7e7b409e226e1, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:31.582151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481905e-8648-48fb-806f-64b5521c6f31 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:31.598827 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 974/1968] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:31 2022] PUT /identity/v3/projects/d554b548122b4b4781ba10671633423b/users/cd56cd6a999b44cab2d7e7b409e226e1/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:31.604017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962498bc-9ce0-4134-9c8e-23c21ddb2a17 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:31.629745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962498bc-9ce0-4134-9c8e-23c21ddb2a17 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:31.752242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481905e-8648-48fb-806f-64b5521c6f31 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:31.754105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a481905e-8648-48fb-806f-64b5521c6f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:31.757938 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979ca55-cf0e-4b36-a5c4-9a38ad5c9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:31.758928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979ca55-cf0e-4b36-a5c4-9a38ad5c9408 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:31.759346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979ca55-cf0e-4b36-a5c4-9a38ad5c9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:31.759756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979ca55-cf0e-4b36-a5c4-9a38ad5c9408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:31.760664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979ca55-cf0e-4b36-a5c4-9a38ad5c9408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:31.762641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979ca55-cf0e-4b36-a5c4-9a38ad5c9408 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:31.777368 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 995/1969] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:31.783195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979ca55-cf0e-4b36-a5c4-9a38ad5c9408 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:31.805420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481905e-8648-48fb-806f-64b5521c6f31 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:31.812619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:31.813556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:31.814342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979ca55-cf0e-4b36-a5c4-9a38ad5c9408 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:31.814457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:31.814457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] PATH_INFO: `/v3/projects/47e412c6d89b4cedb398a7b65e53adb4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:31.815416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e412c6d89b4cedb398a7b65e53adb4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:31.818575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:31.820354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220875c3-5ba4-4a6a-8b28-504f3500bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:31.821502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220875c3-5ba4-4a6a-8b28-504f3500bf18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:31.821915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220875c3-5ba4-4a6a-8b28-504f3500bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:31.822713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220875c3-5ba4-4a6a-8b28-504f3500bf18 admin admin] PATH_INFO: `/v3/projects/d554b548122b4b4781ba10671633423b/users/cd56cd6a999b44cab2d7e7b409e226e1/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:31.826441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220875c3-5ba4-4a6a-8b28-504f3500bf18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d554b548122b4b4781ba10671633423b, user_id=cd56cd6a999b44cab2d7e7b409e226e1, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:31.833229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220875c3-5ba4-4a6a-8b28-504f3500bf18 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:31.859599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 996/1970] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:31 2022] PUT /identity/v3/projects/d554b548122b4b4781ba10671633423b/users/cd56cd6a999b44cab2d7e7b409e226e1/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:31.871006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e4764-468f-4312-a0df-9d1b97fbdab2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:31.871476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e4764-468f-4312-a0df-9d1b97fbdab2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:31.871754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e4764-468f-4312-a0df-9d1b97fbdab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:31.926169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e412c6d89b4cedb398a7b65e53adb4', 'request_id': 'req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:31.927844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1b7e4764-468f-4312-a0df-9d1b97fbdab2 None None] MFA Rules not processed for user `cd56cd6a999b44cab2d7e7b409e226e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:31.929097 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1b7e4764-468f-4312-a0df-9d1b97fbdab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:31.934242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e412c6d89b4cedb398a7b65e53adb4', 'request_id': 'req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:31.947894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e412c6d89b4cedb398a7b65e53adb4', 'request_id': 'req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:31.966619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] The token cache is being invalidate because project 47e412c6d89b4cedb398a7b65e53adb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:31.967013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:31.967598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:31.973843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 975/1971] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:31 2022] DELETE /identity/v3/projects/47e412c6d89b4cedb398a7b65e53adb4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:31.975065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:31.977554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:32.006973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:32.083243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f7452-2cd7-465a-b20c-9c8b143ef5c1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:32.088113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 997/1972] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:32.091382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:32.092319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:32.092648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:32.093044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] PATH_INFO: `/v3/users/f9db36dec5a34f93bc213563ba43df09` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:32.094872 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9db36dec5a34f93bc213563ba43df09)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:32.097187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:32.103590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e4764-468f-4312-a0df-9d1b97fbdab2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:32.106035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1b7e4764-468f-4312-a0df-9d1b97fbdab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:32.115448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:32.198436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9db36dec5a34f93bc213563ba43df09'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:32.203440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e4764-468f-4312-a0df-9d1b97fbdab2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:32.209189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4d8c0-934e-47ed-856d-04ed9d3558d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:32.212289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4d8c0-934e-47ed-856d-04ed9d3558d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:32.212836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4d8c0-934e-47ed-856d-04ed9d3558d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:32.213282 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4d8c0-934e-47ed-856d-04ed9d3558d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:32.216037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e8f4d8c0-934e-47ed-856d-04ed9d3558d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:32.222945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9db36dec5a34f93bc213563ba43df09'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:32.225435 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9db36dec5a34f93bc213563ba43df09'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:32.243654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9db36dec5a34f93bc213563ba43df09'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:32.270671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9db36dec5a34f93bc213563ba43df09'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:32.287395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 976/1973] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:31 2022] DELETE /identity/v3/users/f9db36dec5a34f93bc213563ba43df09 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:32.293598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4d8c0-934e-47ed-856d-04ed9d3558d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:32.295685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4d8c0-934e-47ed-856d-04ed9d3558d1 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:32.333576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 998/1974] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:32.948723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:32.950440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:33.095844 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac014ad0-efb3-4107-b1d0-34162b71337b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:33.110110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:33.112513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:33.112808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:33.117898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] PATH_INFO: `/v3/projects/40ddb4f38dfe4c5b93553be06c1ac1a0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:33.120081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ddb4f38dfe4c5b93553be06c1ac1a0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:33.122282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:33.241776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ddb4f38dfe4c5b93553be06c1ac1a0', 'request_id': 'req-242b6699-adcf-40ed-9635-e6aa34bc5092'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:33.252878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ddb4f38dfe4c5b93553be06c1ac1a0', 'request_id': 'req-242b6699-adcf-40ed-9635-e6aa34bc5092'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:33.265101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ddb4f38dfe4c5b93553be06c1ac1a0', 'request_id': 'req-242b6699-adcf-40ed-9635-e6aa34bc5092'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:33.283892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] The token cache is being invalidate because project 40ddb4f38dfe4c5b93553be06c1ac1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:33.284268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:33.285252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-242b6699-adcf-40ed-9635-e6aa34bc5092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:33.287138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 977/1975] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:32 2022] DELETE /identity/v3/projects/40ddb4f38dfe4c5b93553be06c1ac1a0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:33.293305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622ea8-ffd4-4031-aa2b-28cd6a8f5ba2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:33.294081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622ea8-ffd4-4031-aa2b-28cd6a8f5ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:33.294542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622ea8-ffd4-4031-aa2b-28cd6a8f5ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:33.372775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d4622ea8-ffd4-4031-aa2b-28cd6a8f5ba2 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:33.374397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d4622ea8-ffd4-4031-aa2b-28cd6a8f5ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:33.525135 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 999/1976] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:33.526350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96288a10-eb83-4426-9831-9c4395312415 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:33.526637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96288a10-eb83-4426-9831-9c4395312415 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:33.527119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96288a10-eb83-4426-9831-9c4395312415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:33.560873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-96288a10-eb83-4426-9831-9c4395312415 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:33.562233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-96288a10-eb83-4426-9831-9c4395312415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:33.588027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 978/1977] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:33.589739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622ea8-ffd4-4031-aa2b-28cd6a8f5ba2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:33.613872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622ea8-ffd4-4031-aa2b-28cd6a8f5ba2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:33.624467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1ccf-8a64-4f02-ac12-90a42eb0ccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:33.625530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1ccf-8a64-4f02-ac12-90a42eb0ccaf admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:33.626042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1ccf-8a64-4f02-ac12-90a42eb0ccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:33.626312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1ccf-8a64-4f02-ac12-90a42eb0ccaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:33.627071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e1ccf-8a64-4f02-ac12-90a42eb0ccaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:33.628402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e1ccf-8a64-4f02-ac12-90a42eb0ccaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:33.633156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e1ccf-8a64-4f02-ac12-90a42eb0ccaf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:33.661759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1000/1978] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:33.666063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96288a10-eb83-4426-9831-9c4395312415 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:33.676997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96288a10-eb83-4426-9831-9c4395312415 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:33.694416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c623a5-7887-404f-bb4a-5c920b8f911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:33.695114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c623a5-7887-404f-bb4a-5c920b8f911c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:33.695393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c623a5-7887-404f-bb4a-5c920b8f911c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:33.695671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c623a5-7887-404f-bb4a-5c920b8f911c admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:33.696380 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c623a5-7887-404f-bb4a-5c920b8f911c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:33.698344 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c623a5-7887-404f-bb4a-5c920b8f911c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:33.728551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:33.759446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1ccf-8a64-4f02-ac12-90a42eb0ccaf admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:33.761167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 979/1979] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:33 2022] POST /identity/v3/projects => generated 409 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:33.770341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:33.799438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1ccf-8a64-4f02-ac12-90a42eb0ccaf admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:33.934691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df59502-074b-476f-8cf5-35c62854dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:33.935485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59502-074b-476f-8cf5-35c62854dbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:33.935768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59502-074b-476f-8cf5-35c62854dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:33.936042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59502-074b-476f-8cf5-35c62854dbc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:33.936762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df59502-074b-476f-8cf5-35c62854dbc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:33.939178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df59502-074b-476f-8cf5-35c62854dbc1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:33.999453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1001/1980] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:33 2022] POST /identity/v3/users => generated 305 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:34.000747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c623a5-7887-404f-bb4a-5c920b8f911c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:34.012962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c623a5-7887-404f-bb4a-5c920b8f911c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:34.039025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dcdb3-f798-422b-88ee-2ebe9c7320ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:34.040927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dcdb3-f798-422b-88ee-2ebe9c7320ea admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:34.041246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dcdb3-f798-422b-88ee-2ebe9c7320ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:34.042145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dcdb3-f798-422b-88ee-2ebe9c7320ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:34.047500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dcdb3-f798-422b-88ee-2ebe9c7320ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:34.049095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dcdb3-f798-422b-88ee-2ebe9c7320ea admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:34.102903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 980/1981] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:34.107782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df59502-074b-476f-8cf5-35c62854dbc1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:34.124422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df59502-074b-476f-8cf5-35c62854dbc1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:34.133201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d707d-eeef-4374-8fb3-a70e7b2367ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:34.134004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d707d-eeef-4374-8fb3-a70e7b2367ba admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:34.134372 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d707d-eeef-4374-8fb3-a70e7b2367ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:34.134671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d707d-eeef-4374-8fb3-a70e7b2367ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:34.136121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d707d-eeef-4374-8fb3-a70e7b2367ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:34.138208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d707d-eeef-4374-8fb3-a70e7b2367ba admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:34.167939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1002/1982] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:34.169391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dcdb3-f798-422b-88ee-2ebe9c7320ea admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:34.183572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dcdb3-f798-422b-88ee-2ebe9c7320ea admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:34.195432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d94ad-ba42-4e44-9845-cb80dcddf7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:34.196740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d94ad-ba42-4e44-9845-cb80dcddf7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:34.197084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d94ad-ba42-4e44-9845-cb80dcddf7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:34.198288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d94ad-ba42-4e44-9845-cb80dcddf7c1 admin admin] PATH_INFO: `/v3/projects/5a9cc9c20c4c4442afebe40c0af5204f/users/2065cda5c56a48baa78e07632f68df7c/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:34.239580 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d94ad-ba42-4e44-9845-cb80dcddf7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9cc9c20c4c4442afebe40c0af5204f, user_id=2065cda5c56a48baa78e07632f68df7c, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:34.243001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d94ad-ba42-4e44-9845-cb80dcddf7c1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:34.268233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 981/1983] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:34 2022] PUT /identity/v3/projects/5a9cc9c20c4c4442afebe40c0af5204f/users/2065cda5c56a48baa78e07632f68df7c/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:34.278826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce426ca2-ce89-4efb-952e-30a8101d9dfc None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:34.279109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce426ca2-ce89-4efb-952e-30a8101d9dfc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:34.279393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce426ca2-ce89-4efb-952e-30a8101d9dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:34.344115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ce426ca2-ce89-4efb-952e-30a8101d9dfc None None] MFA Rules not processed for user `2065cda5c56a48baa78e07632f68df7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:34.346257 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ce426ca2-ce89-4efb-952e-30a8101d9dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:34.482079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1003/1984] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:34.487019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d94ad-ba42-4e44-9845-cb80dcddf7c1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:34.613164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d94ad-ba42-4e44-9845-cb80dcddf7c1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:34.632088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8647d02-795c-44e1-bbff-578aafc30319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:34.632929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8647d02-795c-44e1-bbff-578aafc30319 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:34.633286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8647d02-795c-44e1-bbff-578aafc30319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:34.633567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8647d02-795c-44e1-bbff-578aafc30319 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:34.634285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8647d02-795c-44e1-bbff-578aafc30319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:34.637191 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8647d02-795c-44e1-bbff-578aafc30319 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:34.710762 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 982/1985] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:34 2022] POST /identity/v3/projects => generated 407 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:34.713802 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce426ca2-ce89-4efb-952e-30a8101d9dfc None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:34.728711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce426ca2-ce89-4efb-952e-30a8101d9dfc None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:34.875811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665837b-ddcf-41b5-8592-4e64d7949231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:34.876645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665837b-ddcf-41b5-8592-4e64d7949231 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:34.876930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665837b-ddcf-41b5-8592-4e64d7949231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:34.877231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665837b-ddcf-41b5-8592-4e64d7949231 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:34.878122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665837b-ddcf-41b5-8592-4e64d7949231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:34.885465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665837b-ddcf-41b5-8592-4e64d7949231 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:34.909670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:34.921490 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1004/1986] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:34 2022] POST /identity/v3/users => generated 310 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:34.924304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8647d02-795c-44e1-bbff-578aafc30319 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:34.940606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8647d02-795c-44e1-bbff-578aafc30319 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:34.954023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c1d4-bb12-4bf8-b78e-6bbef03c96b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:34.955247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c1d4-bb12-4bf8-b78e-6bbef03c96b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:34.955705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c1d4-bb12-4bf8-b78e-6bbef03c96b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:34.956466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c1d4-bb12-4bf8-b78e-6bbef03c96b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:34.957439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47c1d4-bb12-4bf8-b78e-6bbef03c96b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:34.959245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47c1d4-bb12-4bf8-b78e-6bbef03c96b4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:34.979518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 983/1987] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:34.983914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665837b-ddcf-41b5-8592-4e64d7949231 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:34.997026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665837b-ddcf-41b5-8592-4e64d7949231 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:35.008927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d5ae5-fe30-434c-9e12-406c007472c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:35.009868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5ae5-fe30-434c-9e12-406c007472c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:35.010149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5ae5-fe30-434c-9e12-406c007472c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:35.010983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5ae5-fe30-434c-9e12-406c007472c6 admin admin] PATH_INFO: `/v3/projects/306f01e4b3a7449aa461dda035d5b97b/users/39825cce147042fa87983e6f365df7d2/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:35.038209 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d5ae5-fe30-434c-9e12-406c007472c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306f01e4b3a7449aa461dda035d5b97b, user_id=39825cce147042fa87983e6f365df7d2, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:35.041713 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d5ae5-fe30-434c-9e12-406c007472c6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:35.068987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1005/1988] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:34 2022] PUT /identity/v3/projects/306f01e4b3a7449aa461dda035d5b97b/users/39825cce147042fa87983e6f365df7d2/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:35.072193 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c1d4-bb12-4bf8-b78e-6bbef03c96b4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:35.093551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c1d4-bb12-4bf8-b78e-6bbef03c96b4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:35.180237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ee045-f4cd-4a35-827b-7cf38930d6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:35.185805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ee045-f4cd-4a35-827b-7cf38930d6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:35.186092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ee045-f4cd-4a35-827b-7cf38930d6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:35.186405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ee045-f4cd-4a35-827b-7cf38930d6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:35.187338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ee045-f4cd-4a35-827b-7cf38930d6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:35.189451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ee045-f4cd-4a35-827b-7cf38930d6d0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:35.237541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 984/1989] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:35.240986 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d5ae5-fe30-434c-9e12-406c007472c6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:35.254742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d5ae5-fe30-434c-9e12-406c007472c6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:35.266835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c559-7fc6-44c7-b513-df0215b479ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:35.268040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c559-7fc6-44c7-b513-df0215b479ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:35.268330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c559-7fc6-44c7-b513-df0215b479ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:35.268609 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c559-7fc6-44c7-b513-df0215b479ef admin admin] PATH_INFO: `/v3/projects/306f01e4b3a7449aa461dda035d5b97b/users/39825cce147042fa87983e6f365df7d2/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:35.271732 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743c559-7fc6-44c7-b513-df0215b479ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=306f01e4b3a7449aa461dda035d5b97b, user_id=39825cce147042fa87983e6f365df7d2, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:35.275319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743c559-7fc6-44c7-b513-df0215b479ef admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:35.304518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1006/1990] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:35 2022] PUT /identity/v3/projects/306f01e4b3a7449aa461dda035d5b97b/users/39825cce147042fa87983e6f365df7d2/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:35.308698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319ef8c-9363-44ab-bfa5-32d84b372372 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:35.308997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319ef8c-9363-44ab-bfa5-32d84b372372 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:35.309291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319ef8c-9363-44ab-bfa5-32d84b372372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:35.341321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e319ef8c-9363-44ab-bfa5-32d84b372372 None None] MFA Rules not processed for user `39825cce147042fa87983e6f365df7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:35.343228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e319ef8c-9363-44ab-bfa5-32d84b372372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:35.348439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c559-7fc6-44c7-b513-df0215b479ef admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:35.350839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4743c559-7fc6-44c7-b513-df0215b479ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:35.372413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:35.460179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c559-7fc6-44c7-b513-df0215b479ef admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:35.465825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:35.466872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:35.467217 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:35.467789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] PATH_INFO: `/v3/users/670f52a75dbf466e9ef990d4afa4d948` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:35.469945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=670f52a75dbf466e9ef990d4afa4d948)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:35.471481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:35.483027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 985/1991] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:35 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:35.499164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319ef8c-9363-44ab-bfa5-32d84b372372 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:35.503992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e319ef8c-9363-44ab-bfa5-32d84b372372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:35.565712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670f52a75dbf466e9ef990d4afa4d948'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:35.574728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670f52a75dbf466e9ef990d4afa4d948'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:35.575797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670f52a75dbf466e9ef990d4afa4d948'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:35.589703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670f52a75dbf466e9ef990d4afa4d948'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:35.591139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1ff700f-2a74-40f1-b96f-5300c5c4c4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670f52a75dbf466e9ef990d4afa4d948'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:35.592123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319ef8c-9363-44ab-bfa5-32d84b372372 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:35.597470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdba28f-ebb5-4a32-9614-042c51d4cef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:35.597911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdba28f-ebb5-4a32-9614-042c51d4cef7 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:35.598195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdba28f-ebb5-4a32-9614-042c51d4cef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:35.598473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdba28f-ebb5-4a32-9614-042c51d4cef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:35.601552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5cdba28f-ebb5-4a32-9614-042c51d4cef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:35.619106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1007/1992] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:35 2022] DELETE /identity/v3/users/670f52a75dbf466e9ef990d4afa4d948 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:35.626156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdba28f-ebb5-4a32-9614-042c51d4cef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:35.627636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdba28f-ebb5-4a32-9614-042c51d4cef7 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:35.627970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5f6d3-e03a-4584-9805-36ce7e79bc09 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:35.628290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5f6d3-e03a-4584-9805-36ce7e79bc09 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:35.628731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5f6d3-e03a-4584-9805-36ce7e79bc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:35.643722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 986/1993] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:35.658699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-98c5f6d3-e03a-4584-9805-36ce7e79bc09 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:35.661030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98c5f6d3-e03a-4584-9805-36ce7e79bc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:35.760888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:35.793834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1008/1994] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:35.800749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdba28f-ebb5-4a32-9614-042c51d4cef7 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:35.802389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5cdba28f-ebb5-4a32-9614-042c51d4cef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:35.909548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdba28f-ebb5-4a32-9614-042c51d4cef7 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:35.994894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5f6d3-e03a-4584-9805-36ce7e79bc09 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:35.997916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98c5f6d3-e03a-4584-9805-36ce7e79bc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:36.031508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971acff9-7663-49b2-a242-844891e439f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:36.034714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acff9-7663-49b2-a242-844891e439f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:36.035111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acff9-7663-49b2-a242-844891e439f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:36.035412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acff9-7663-49b2-a242-844891e439f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:36.057929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971acff9-7663-49b2-a242-844891e439f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:36.059494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971acff9-7663-49b2-a242-844891e439f9 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:36.075020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 987/1995] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:36.089644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5f6d3-e03a-4584-9805-36ce7e79bc09 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:36.094041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27006498-3012-4aec-8092-bfea596b74cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:36.095055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27006498-3012-4aec-8092-bfea596b74cd service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:36.095539 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27006498-3012-4aec-8092-bfea596b74cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:36.095986 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27006498-3012-4aec-8092-bfea596b74cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:36.099568 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-27006498-3012-4aec-8092-bfea596b74cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:36.165569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27006498-3012-4aec-8092-bfea596b74cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:36.167046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27006498-3012-4aec-8092-bfea596b74cd service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:36.178684 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1009/1996] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:36.710799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971acff9-7663-49b2-a242-844891e439f9 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:36.712037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-971acff9-7663-49b2-a242-844891e439f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:36.728060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971acff9-7663-49b2-a242-844891e439f9 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:36.733157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:36.734298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:36.734697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:36.734976 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] PATH_INFO: `/v3/projects/1c125e62e0274bc8a70619863e224867` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:36.736458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c125e62e0274bc8a70619863e224867)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:36.738507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:36.768129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:36.823845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c125e62e0274bc8a70619863e224867', 'request_id': 'req-3a03acea-aef5-4309-a730-a82379aade6f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:36.832648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c125e62e0274bc8a70619863e224867', 'request_id': 'req-3a03acea-aef5-4309-a730-a82379aade6f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:36.844888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c125e62e0274bc8a70619863e224867', 'request_id': 'req-3a03acea-aef5-4309-a730-a82379aade6f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:36.857060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] The token cache is being invalidate because project 1c125e62e0274bc8a70619863e224867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:36.857399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:36.858076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:36.860547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 988/1997] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:36 2022] DELETE /identity/v3/projects/1c125e62e0274bc8a70619863e224867 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:36.864387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27006498-3012-4aec-8092-bfea596b74cd service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:36.875940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27006498-3012-4aec-8092-bfea596b74cd service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:36.938888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:36.939694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:36.939970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:36.940214 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] PATH_INFO: `/v3/users/cd56cd6a999b44cab2d7e7b409e226e1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:36.941466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd56cd6a999b44cab2d7e7b409e226e1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:36.943406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:36.988064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:36.996055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd56cd6a999b44cab2d7e7b409e226e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:37.004019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd56cd6a999b44cab2d7e7b409e226e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:37.004748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd56cd6a999b44cab2d7e7b409e226e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:37.014522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd56cd6a999b44cab2d7e7b409e226e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:37.015253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd7bf3f6-76bc-4555-be02-0f2fa91a7778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd56cd6a999b44cab2d7e7b409e226e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:37.033978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1010/1998] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:36 2022] DELETE /identity/v3/users/cd56cd6a999b44cab2d7e7b409e226e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:37.341643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:37.343114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:37.357530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03acea-aef5-4309-a730-a82379aade6f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:37.423482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:37.424362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:37.424637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:37.424906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] PATH_INFO: `/v3/projects/d554b548122b4b4781ba10671633423b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:37.426155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d554b548122b4b4781ba10671633423b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:37.428233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:37.480119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd554b548122b4b4781ba10671633423b', 'request_id': 'req-7c82075b-a5ec-4040-b3b6-0618841bee55'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:37.486992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd554b548122b4b4781ba10671633423b', 'request_id': 'req-7c82075b-a5ec-4040-b3b6-0618841bee55'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:37.495520 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd554b548122b4b4781ba10671633423b', 'request_id': 'req-7c82075b-a5ec-4040-b3b6-0618841bee55'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:37.518460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] The token cache is being invalidate because project d554b548122b4b4781ba10671633423b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:37.518816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:37.519396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c82075b-a5ec-4040-b3b6-0618841bee55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:37.520962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 989/1999] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:37 2022] DELETE /identity/v3/projects/d554b548122b4b4781ba10671633423b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:37.525916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f314ea-ca0d-43b3-9b3c-591384aa4985 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:37.526557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f314ea-ca0d-43b3-9b3c-591384aa4985 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:37.526893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f314ea-ca0d-43b3-9b3c-591384aa4985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:37.545796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b0f314ea-ca0d-43b3-9b3c-591384aa4985 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:37.547208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b0f314ea-ca0d-43b3-9b3c-591384aa4985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:37.614883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1011/2000] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:37.622226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6997c-4468-415f-a8f3-c16a02e0e82b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:37.622515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6997c-4468-415f-a8f3-c16a02e0e82b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:37.622794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6997c-4468-415f-a8f3-c16a02e0e82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:37.641672 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bda6997c-4468-415f-a8f3-c16a02e0e82b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:37.642882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bda6997c-4468-415f-a8f3-c16a02e0e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:37.650848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 990/2001] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:37.655183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f314ea-ca0d-43b3-9b3c-591384aa4985 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:37.665357 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f314ea-ca0d-43b3-9b3c-591384aa4985 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:37.677277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b4fee-53c4-4132-a725-3636cf4c9fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:37.677998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b4fee-53c4-4132-a725-3636cf4c9fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:37.678275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b4fee-53c4-4132-a725-3636cf4c9fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:37.678549 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b4fee-53c4-4132-a725-3636cf4c9fc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:37.679281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b4fee-53c4-4132-a725-3636cf4c9fc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:37.679555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b4fee-53c4-4132-a725-3636cf4c9fc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:37.681192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b4fee-53c4-4132-a725-3636cf4c9fc7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:37.693402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1012/2002] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:37.697901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6997c-4468-415f-a8f3-c16a02e0e82b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:37.708583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6997c-4468-415f-a8f3-c16a02e0e82b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:37.713648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e4394-3942-4f1c-82bf-d895eb4d4dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:37.714312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e4394-3942-4f1c-82bf-d895eb4d4dbd admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:37.714595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e4394-3942-4f1c-82bf-d895eb4d4dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:37.714872 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e4394-3942-4f1c-82bf-d895eb4d4dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:37.715581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e4394-3942-4f1c-82bf-d895eb4d4dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:37.717529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e4394-3942-4f1c-82bf-d895eb4d4dbd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:37.742312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:37.752304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 991/2003] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:37 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:37.755683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b4fee-53c4-4132-a725-3636cf4c9fc7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:37.766236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b4fee-53c4-4132-a725-3636cf4c9fc7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:37.840864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48d8c6-0cdf-4862-a980-3ad26f38d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:37.841662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48d8c6-0cdf-4862-a980-3ad26f38d546 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:37.841945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48d8c6-0cdf-4862-a980-3ad26f38d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:37.842222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48d8c6-0cdf-4862-a980-3ad26f38d546 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:37.843092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48d8c6-0cdf-4862-a980-3ad26f38d546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:37.845915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48d8c6-0cdf-4862-a980-3ad26f38d546 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:37.874474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1013/2004] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:37 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:37.878717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e4394-3942-4f1c-82bf-d895eb4d4dbd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:37.894789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e4394-3942-4f1c-82bf-d895eb4d4dbd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:37.899892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e152a-41d8-453c-9a20-98c00255d269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:37.900607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e152a-41d8-453c-9a20-98c00255d269 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:37.900884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e152a-41d8-453c-9a20-98c00255d269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:37.901153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e152a-41d8-453c-9a20-98c00255d269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:37.902179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e152a-41d8-453c-9a20-98c00255d269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:37.903706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e152a-41d8-453c-9a20-98c00255d269 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:37.924308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 992/2005] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:37.928528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48d8c6-0cdf-4862-a980-3ad26f38d546 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:37.944601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48d8c6-0cdf-4862-a980-3ad26f38d546 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:37.953605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd99dac-da76-490b-a822-35348af18c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:37.954297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd99dac-da76-490b-a822-35348af18c31 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:37.954577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd99dac-da76-490b-a822-35348af18c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:37.954855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd99dac-da76-490b-a822-35348af18c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:37.955670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd99dac-da76-490b-a822-35348af18c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:37.957223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd99dac-da76-490b-a822-35348af18c31 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:37.972043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1014/2006] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:37.973596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e152a-41d8-453c-9a20-98c00255d269 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:37.984360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e152a-41d8-453c-9a20-98c00255d269 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:37.990640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a37b-f320-4175-bc00-6327f6339905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:37.991704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a37b-f320-4175-bc00-6327f6339905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:37.992053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a37b-f320-4175-bc00-6327f6339905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:37.992483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a37b-f320-4175-bc00-6327f6339905 admin admin] PATH_INFO: `/v3/projects/5fa23bcaad7046fc9c6396d06ca7ca05/users/b99380ddefb94a99ab550870757f1b75/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:38.016084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806a37b-f320-4175-bc00-6327f6339905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa23bcaad7046fc9c6396d06ca7ca05, user_id=b99380ddefb94a99ab550870757f1b75, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:38.018850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806a37b-f320-4175-bc00-6327f6339905 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:38.048129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 993/2007] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:37 2022] PUT /identity/v3/projects/5fa23bcaad7046fc9c6396d06ca7ca05/users/b99380ddefb94a99ab550870757f1b75/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:38.059413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07be9-562f-4268-845a-a16499378293 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:38.059700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07be9-562f-4268-845a-a16499378293 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:38.060111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07be9-562f-4268-845a-a16499378293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:38.110233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-72f07be9-562f-4268-845a-a16499378293 None None] MFA Rules not processed for user `b99380ddefb94a99ab550870757f1b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:38.111452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-72f07be9-562f-4268-845a-a16499378293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:38.123865 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:38.193889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1015/2008] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:38.205987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a37b-f320-4175-bc00-6327f6339905 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:38.208253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3806a37b-f320-4175-bc00-6327f6339905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:38.298112 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a37b-f320-4175-bc00-6327f6339905 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:38.301815 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e109a7-dcfd-4a3d-a7c3-e7bc0cd0f339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:38.302474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e109a7-dcfd-4a3d-a7c3-e7bc0cd0f339 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:38.302757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e109a7-dcfd-4a3d-a7c3-e7bc0cd0f339 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:38.303064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e109a7-dcfd-4a3d-a7c3-e7bc0cd0f339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:38.312882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e109a7-dcfd-4a3d-a7c3-e7bc0cd0f339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:38.314400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e109a7-dcfd-4a3d-a7c3-e7bc0cd0f339 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:38.324189 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 994/2009] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:41.436085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07be9-562f-4268-845a-a16499378293 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:41.503344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07be9-562f-4268-845a-a16499378293 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:41.508161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:41.509075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:41.509388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:41.509671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] PATH_INFO: `/v3/users/b99380ddefb94a99ab550870757f1b75` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:41.510937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99380ddefb94a99ab550870757f1b75)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:41.512887 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:41.569477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99380ddefb94a99ab550870757f1b75'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:41.578926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99380ddefb94a99ab550870757f1b75'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:41.579862 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99380ddefb94a99ab550870757f1b75'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:41.589854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99380ddefb94a99ab550870757f1b75'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:41.590776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99380ddefb94a99ab550870757f1b75'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:41.610285 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1016/2010] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:41 2022] DELETE /identity/v3/users/b99380ddefb94a99ab550870757f1b75 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:41.615008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1e92e-4b9d-42e0-828e-0d8c883ff2eb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:41.615505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1e92e-4b9d-42e0-828e-0d8c883ff2eb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:41.615703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1e92e-4b9d-42e0-828e-0d8c883ff2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:41.635736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-69a1e92e-4b9d-42e0-828e-0d8c883ff2eb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:41.637276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-69a1e92e-4b9d-42e0-828e-0d8c883ff2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:41.712902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 995/2011] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:41.723460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:41.725151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:41.745028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1e92e-4b9d-42e0-828e-0d8c883ff2eb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:41.746895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-69a1e92e-4b9d-42e0-828e-0d8c883ff2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:41.761173 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1e92e-4b9d-42e0-828e-0d8c883ff2eb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:41.766301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:41.767208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:41.767544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:41.767882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] PATH_INFO: `/v3/users/2065cda5c56a48baa78e07632f68df7c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:41.769123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2065cda5c56a48baa78e07632f68df7c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:41.771224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:41.779356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:41.823585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00059a7f-95f2-4145-be30-5e9b7039ecad admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:41.828593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194631f1-63c0-44bf-98c8-9678386cda99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:41.829358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194631f1-63c0-44bf-98c8-9678386cda99 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:41.829685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194631f1-63c0-44bf-98c8-9678386cda99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:41.830309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194631f1-63c0-44bf-98c8-9678386cda99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:41.836324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2065cda5c56a48baa78e07632f68df7c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:41.847889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194631f1-63c0-44bf-98c8-9678386cda99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:41.849073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2065cda5c56a48baa78e07632f68df7c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:41.850073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2065cda5c56a48baa78e07632f68df7c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:41.850214 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194631f1-63c0-44bf-98c8-9678386cda99 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:41.863671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1017/2012] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:41.866820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2065cda5c56a48baa78e07632f68df7c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:41.868498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:41.891882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2065cda5c56a48baa78e07632f68df7c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:41.905416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 996/2013] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:41 2022] DELETE /identity/v3/users/2065cda5c56a48baa78e07632f68df7c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:41.907518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4af4-3909-4b9b-a547-6a7810a33c3b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:41.907813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4af4-3909-4b9b-a547-6a7810a33c3b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:41.908907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4af4-3909-4b9b-a547-6a7810a33c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:41.940871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-18ee4af4-3909-4b9b-a547-6a7810a33c3b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:41.942987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-18ee4af4-3909-4b9b-a547-6a7810a33c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:42.034355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1018/2014] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:42.044215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:42.045851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:42.127538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903251c-0b8d-4378-9e46-0c5442464776 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:42.137897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d6622-f0c2-4301-a6e4-120602c18aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:42.138575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6622-f0c2-4301-a6e4-120602c18aff service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:42.138901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6622-f0c2-4301-a6e4-120602c18aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:42.139280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6622-f0c2-4301-a6e4-120602c18aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:42.156095 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d6622-f0c2-4301-a6e4-120602c18aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:42.157636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d6622-f0c2-4301-a6e4-120602c18aff service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:42.168929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 997/2015] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:42.218928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee4af4-3909-4b9b-a547-6a7810a33c3b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:42.220517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-18ee4af4-3909-4b9b-a547-6a7810a33c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:42.232680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee4af4-3909-4b9b-a547-6a7810a33c3b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:42.243256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:42.244402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:42.244720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:42.245579 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] PATH_INFO: `/v3/projects/5fa23bcaad7046fc9c6396d06ca7ca05` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:42.246855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa23bcaad7046fc9c6396d06ca7ca05)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:42.248834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:42.310687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa23bcaad7046fc9c6396d06ca7ca05', 'request_id': 'req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.317361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa23bcaad7046fc9c6396d06ca7ca05', 'request_id': 'req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.331866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa23bcaad7046fc9c6396d06ca7ca05', 'request_id': 'req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.348238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] The token cache is being invalidate because project 5fa23bcaad7046fc9c6396d06ca7ca05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:42.348531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.349195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4f7ff89f-d9a8-4292-b4ac-1d0b5419f7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.350817 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1019/2016] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:42 2022] DELETE /identity/v3/projects/5fa23bcaad7046fc9c6396d06ca7ca05 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:42.356211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435f84-eb91-4008-aacc-54c6a45c4386 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:42.356554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435f84-eb91-4008-aacc-54c6a45c4386 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:42.356825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435f84-eb91-4008-aacc-54c6a45c4386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:42.375231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3e435f84-eb91-4008-aacc-54c6a45c4386 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:42.376539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3e435f84-eb91-4008-aacc-54c6a45c4386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:42.453893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 998/2017] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:42.457772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46bc7d-f7de-4b22-abe2-710ed9ada402 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:42.458245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46bc7d-f7de-4b22-abe2-710ed9ada402 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:42.458492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46bc7d-f7de-4b22-abe2-710ed9ada402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:42.480487 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435f84-eb91-4008-aacc-54c6a45c4386 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:42.483582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3e435f84-eb91-4008-aacc-54c6a45c4386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:42.501498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435f84-eb91-4008-aacc-54c6a45c4386 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:42.507845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:42.507845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:42.507845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:42.508217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] PATH_INFO: `/v3/projects/5a9cc9c20c4c4442afebe40c0af5204f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:42.518188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8c46bc7d-f7de-4b22-abe2-710ed9ada402 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:42.522126 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9cc9c20c4c4442afebe40c0af5204f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:42.523656 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8c46bc7d-f7de-4b22-abe2-710ed9ada402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:42.524727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:42.549715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1020/2018] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:42.550643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46bc7d-f7de-4b22-abe2-710ed9ada402 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:42.560589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46bc7d-f7de-4b22-abe2-710ed9ada402 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:42.566654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf9473-cbc5-4932-8998-e5f08774efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:42.567350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf9473-cbc5-4932-8998-e5f08774efd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:42.567692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf9473-cbc5-4932-8998-e5f08774efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:42.567937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf9473-cbc5-4932-8998-e5f08774efd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:42.568671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf9473-cbc5-4932-8998-e5f08774efd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:42.569041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf9473-cbc5-4932-8998-e5f08774efd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:42.571208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf9473-cbc5-4932-8998-e5f08774efd8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:42.592893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1021/2019] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:42.593894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf9473-cbc5-4932-8998-e5f08774efd8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:42.609043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf9473-cbc5-4932-8998-e5f08774efd8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:42.632334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9cc9c20c4c4442afebe40c0af5204f', 'request_id': 'req-c5874096-fd51-4cbd-8d93-618511dd1c7b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.642587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9cc9c20c4c4442afebe40c0af5204f', 'request_id': 'req-c5874096-fd51-4cbd-8d93-618511dd1c7b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.656538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9cc9c20c4c4442afebe40c0af5204f', 'request_id': 'req-c5874096-fd51-4cbd-8d93-618511dd1c7b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.668343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:42.682773 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] The token cache is being invalidate because project 5a9cc9c20c4c4442afebe40c0af5204f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:42.683060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.684851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.690011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 999/2020] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:42 2022] DELETE /identity/v3/projects/5a9cc9c20c4c4442afebe40c0af5204f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:42.694100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:42.695827 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:42.705668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edf9d4-86cb-4709-af03-71421c302213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:42.706529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edf9d4-86cb-4709-af03-71421c302213 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:42.706810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edf9d4-86cb-4709-af03-71421c302213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:42.707093 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edf9d4-86cb-4709-af03-71421c302213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:42.707776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edf9d4-86cb-4709-af03-71421c302213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:42.709860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edf9d4-86cb-4709-af03-71421c302213 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:42.724714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5874096-fd51-4cbd-8d93-618511dd1c7b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:42.730735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:42.732008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:42.732498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:42.732966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] PATH_INFO: `/v3/users/39825cce147042fa87983e6f365df7d2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:42.734337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39825cce147042fa87983e6f365df7d2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:42.736481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:42.738500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:42.746722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1022/2021] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:42 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:42.752034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edf9d4-86cb-4709-af03-71421c302213 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:42.754433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-40edf9d4-86cb-4709-af03-71421c302213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:42.830887 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39825cce147042fa87983e6f365df7d2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.848521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39825cce147042fa87983e6f365df7d2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.849268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39825cce147042fa87983e6f365df7d2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.874321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39825cce147042fa87983e6f365df7d2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.882837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edf9d4-86cb-4709-af03-71421c302213 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:42.885907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39825cce147042fa87983e6f365df7d2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:42.894987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbd9c8-0ffb-4e94-85a3-2d80056c7141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:42.895675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbd9c8-0ffb-4e94-85a3-2d80056c7141 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:42.895953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbd9c8-0ffb-4e94-85a3-2d80056c7141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:42.896227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbd9c8-0ffb-4e94-85a3-2d80056c7141 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:42.896922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbd9c8-0ffb-4e94-85a3-2d80056c7141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:42.899262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbd9c8-0ffb-4e94-85a3-2d80056c7141 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:42.900166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1000/2022] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:42 2022] DELETE /identity/v3/users/39825cce147042fa87983e6f365df7d2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:42.928150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1023/2023] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:42 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:42.932554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:42.934203 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:43.014693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb83b-84c6-4794-a7fa-6c6024297bb0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:43.024083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e58d-f23f-4f52-ac4a-0e54eacbc35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:43.025651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e58d-f23f-4f52-ac4a-0e54eacbc35f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:43.025981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e58d-f23f-4f52-ac4a-0e54eacbc35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:43.026325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e58d-f23f-4f52-ac4a-0e54eacbc35f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:43.027216 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466e58d-f23f-4f52-ac4a-0e54eacbc35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:43.030506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466e58d-f23f-4f52-ac4a-0e54eacbc35f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:43.046581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1001/2024] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:43.051279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbd9c8-0ffb-4e94-85a3-2d80056c7141 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:43.064354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbd9c8-0ffb-4e94-85a3-2d80056c7141 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:43.069805 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad1258-4273-4ba2-b4b5-b5c25ae0c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:43.071134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad1258-4273-4ba2-b4b5-b5c25ae0c84e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:43.071275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad1258-4273-4ba2-b4b5-b5c25ae0c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:43.071509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad1258-4273-4ba2-b4b5-b5c25ae0c84e admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:43.072547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad1258-4273-4ba2-b4b5-b5c25ae0c84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:43.086434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad1258-4273-4ba2-b4b5-b5c25ae0c84e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:43.099428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1024/2025] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:43.103650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e58d-f23f-4f52-ac4a-0e54eacbc35f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:43.115230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e58d-f23f-4f52-ac4a-0e54eacbc35f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:43.121433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187de34-7a32-4df0-bb0b-136ec627db43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:43.123080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187de34-7a32-4df0-bb0b-136ec627db43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:43.123584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187de34-7a32-4df0-bb0b-136ec627db43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:43.124015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187de34-7a32-4df0-bb0b-136ec627db43 admin admin] PATH_INFO: `/v3/projects/1aff0a255b704ef6a20b4c38d9f3c29d/users/56019fbe8a4348c3a0e9d2b5f9fbed79/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:43.146618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187de34-7a32-4df0-bb0b-136ec627db43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aff0a255b704ef6a20b4c38d9f3c29d, user_id=56019fbe8a4348c3a0e9d2b5f9fbed79, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:43.149224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187de34-7a32-4df0-bb0b-136ec627db43 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:43.166288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1002/2026] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:43 2022] PUT /identity/v3/projects/1aff0a255b704ef6a20b4c38d9f3c29d/users/56019fbe8a4348c3a0e9d2b5f9fbed79/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:43.176409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a4ab8-165c-42ef-99f7-5503c8604079 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:43.176697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a4ab8-165c-42ef-99f7-5503c8604079 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:43.176980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a4ab8-165c-42ef-99f7-5503c8604079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:43.205730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d95a4ab8-165c-42ef-99f7-5503c8604079 None None] MFA Rules not processed for user `56019fbe8a4348c3a0e9d2b5f9fbed79`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:43.207001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d95a4ab8-165c-42ef-99f7-5503c8604079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:43.291277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1025/2027] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:43.299805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187de34-7a32-4df0-bb0b-136ec627db43 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:43.302221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d187de34-7a32-4df0-bb0b-136ec627db43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:43.373474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187de34-7a32-4df0-bb0b-136ec627db43 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:43.378395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ddfe4-6e6e-47cf-9ddd-7bd3e6adac9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:43.379136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ddfe4-6e6e-47cf-9ddd-7bd3e6adac9e service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:43.380000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ddfe4-6e6e-47cf-9ddd-7bd3e6adac9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:43.380000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ddfe4-6e6e-47cf-9ddd-7bd3e6adac9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:43.387762 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:43.391793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ddfe4-6e6e-47cf-9ddd-7bd3e6adac9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:43.393501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ddfe4-6e6e-47cf-9ddd-7bd3e6adac9e service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:43.412526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a4ab8-165c-42ef-99f7-5503c8604079 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:43.416051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d95a4ab8-165c-42ef-99f7-5503c8604079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:43.416410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1003/2028] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:43.463098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:43.502338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a4ab8-165c-42ef-99f7-5503c8604079 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:43.506931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:43.509321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:43.509321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:43.509321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] PATH_INFO: `/v3/projects/306f01e4b3a7449aa461dda035d5b97b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:43.510301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306f01e4b3a7449aa461dda035d5b97b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:43.512423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:43.631706 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306f01e4b3a7449aa461dda035d5b97b', 'request_id': 'req-dba24019-9d01-4fd3-a8f7-78f35d070992'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:43.640404 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306f01e4b3a7449aa461dda035d5b97b', 'request_id': 'req-dba24019-9d01-4fd3-a8f7-78f35d070992'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:43.655806 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306f01e4b3a7449aa461dda035d5b97b', 'request_id': 'req-dba24019-9d01-4fd3-a8f7-78f35d070992'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:43.677138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] The token cache is being invalidate because project 306f01e4b3a7449aa461dda035d5b97b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:43.677539 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:43.678201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dba24019-9d01-4fd3-a8f7-78f35d070992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:43.685935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1026/2029] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:43 2022] DELETE /identity/v3/projects/306f01e4b3a7449aa461dda035d5b97b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:43.686718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769bb2-c951-49a7-a38f-17f9130ee37c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:43.687616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769bb2-c951-49a7-a38f-17f9130ee37c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:43.688422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769bb2-c951-49a7-a38f-17f9130ee37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:43.739530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-58769bb2-c951-49a7-a38f-17f9130ee37c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:43.740854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58769bb2-c951-49a7-a38f-17f9130ee37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:43.811599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1004/2030] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:43.820816 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51d455-62b6-4f86-ba67-378e27208a59 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:43.821027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51d455-62b6-4f86-ba67-378e27208a59 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:43.821356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51d455-62b6-4f86-ba67-378e27208a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:43.848533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3f51d455-62b6-4f86-ba67-378e27208a59 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:43.849900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3f51d455-62b6-4f86-ba67-378e27208a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:43.869944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1027/2031] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:43.871249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769bb2-c951-49a7-a38f-17f9130ee37c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:43.882305 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769bb2-c951-49a7-a38f-17f9130ee37c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:43.888801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0f898-0b87-46e8-aef5-58ea4384403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:43.889702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0f898-0b87-46e8-aef5-58ea4384403a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:43.889923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0f898-0b87-46e8-aef5-58ea4384403a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:43.890351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0f898-0b87-46e8-aef5-58ea4384403a admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:43.891215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0f898-0b87-46e8-aef5-58ea4384403a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:43.891496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0f898-0b87-46e8-aef5-58ea4384403a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:43.893700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0f898-0b87-46e8-aef5-58ea4384403a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:43.920159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1005/2032] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:43.920958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51d455-62b6-4f86-ba67-378e27208a59 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:43.932778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51d455-62b6-4f86-ba67-378e27208a59 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:43.939044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b6ddf-ca79-4062-8c5e-23cb5caad804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:43.939998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6ddf-ca79-4062-8c5e-23cb5caad804 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:43.940485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6ddf-ca79-4062-8c5e-23cb5caad804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:43.940975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6ddf-ca79-4062-8c5e-23cb5caad804 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:43.941908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b6ddf-ca79-4062-8c5e-23cb5caad804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:43.945041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b6ddf-ca79-4062-8c5e-23cb5caad804 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.004073 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1028/2033] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:43 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:44.005097 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0f898-0b87-46e8-aef5-58ea4384403a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:44.024159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0f898-0b87-46e8-aef5-58ea4384403a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:44.094708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a357f-f9ed-42a1-8699-8500242cba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:44.095446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a357f-f9ed-42a1-8699-8500242cba8b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.095860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a357f-f9ed-42a1-8699-8500242cba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.096216 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a357f-f9ed-42a1-8699-8500242cba8b admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.097139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a357f-f9ed-42a1-8699-8500242cba8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:44.101860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a357f-f9ed-42a1-8699-8500242cba8b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.129754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1006/2034] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:44 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:44.133622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b6ddf-ca79-4062-8c5e-23cb5caad804 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:44.149424 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b6ddf-ca79-4062-8c5e-23cb5caad804 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:44.155889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb734e5e-8adb-4a29-8941-65907ab585d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:44.156832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb734e5e-8adb-4a29-8941-65907ab585d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.157966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb734e5e-8adb-4a29-8941-65907ab585d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.157966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb734e5e-8adb-4a29-8941-65907ab585d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.158542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb734e5e-8adb-4a29-8941-65907ab585d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:44.160429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb734e5e-8adb-4a29-8941-65907ab585d8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.175483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1029/2035] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:44.179185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a357f-f9ed-42a1-8699-8500242cba8b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:44.193841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a357f-f9ed-42a1-8699-8500242cba8b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:44.200592 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e32b-6d07-451b-a112-210150ac6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:44.204236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e32b-6d07-451b-a112-210150ac6204 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.204236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e32b-6d07-451b-a112-210150ac6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.204236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e32b-6d07-451b-a112-210150ac6204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.204236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768e32b-6d07-451b-a112-210150ac6204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:44.205308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768e32b-6d07-451b-a112-210150ac6204 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.224512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb734e5e-8adb-4a29-8941-65907ab585d8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:44.232080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1007/2036] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:44.236212 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb734e5e-8adb-4a29-8941-65907ab585d8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:44.244501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaffae-0ea5-423f-836f-bf1a001af412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:44.245553 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaffae-0ea5-423f-836f-bf1a001af412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.245839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaffae-0ea5-423f-836f-bf1a001af412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.246159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaffae-0ea5-423f-836f-bf1a001af412 admin admin] PATH_INFO: `/v3/projects/fb6fa249285a4b1894d231450acfa4a3/users/3fce82a8b3984c6cb98ce444b2d97c63/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.264765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaffae-0ea5-423f-836f-bf1a001af412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6fa249285a4b1894d231450acfa4a3, user_id=3fce82a8b3984c6cb98ce444b2d97c63, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:44.267552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaffae-0ea5-423f-836f-bf1a001af412 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.284474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1030/2037] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:44 2022] PUT /identity/v3/projects/fb6fa249285a4b1894d231450acfa4a3/users/3fce82a8b3984c6cb98ce444b2d97c63/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:44.295824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8c04-9f67-4503-a6a0-dfb5f10bace6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.296113 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8c04-9f67-4503-a6a0-dfb5f10bace6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.296398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8c04-9f67-4503-a6a0-dfb5f10bace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.331340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-319a8c04-9f67-4503-a6a0-dfb5f10bace6 None None] MFA Rules not processed for user `3fce82a8b3984c6cb98ce444b2d97c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:44.332597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-319a8c04-9f67-4503-a6a0-dfb5f10bace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:44.391480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:44.413104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1008/2038] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:44.417797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaffae-0ea5-423f-836f-bf1a001af412 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:44.491960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:44.495955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaffae-0ea5-423f-836f-bf1a001af412 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:44.503808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae21be8-03f7-4705-88a5-9704fe1f91ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:44.505607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21be8-03f7-4705-88a5-9704fe1f91ea admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.506357 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21be8-03f7-4705-88a5-9704fe1f91ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.506803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21be8-03f7-4705-88a5-9704fe1f91ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.507565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae21be8-03f7-4705-88a5-9704fe1f91ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:44.509905 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae21be8-03f7-4705-88a5-9704fe1f91ea admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.562693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1031/2039] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:44 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:44.566993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8c04-9f67-4503-a6a0-dfb5f10bace6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:44.585170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8c04-9f67-4503-a6a0-dfb5f10bace6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:44.651270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbf187-5b89-4580-aead-548f2cf7a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:44.651955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbf187-5b89-4580-aead-548f2cf7a8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.652236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbf187-5b89-4580-aead-548f2cf7a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.652532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbf187-5b89-4580-aead-548f2cf7a8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.653333 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbf187-5b89-4580-aead-548f2cf7a8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:44.655339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbf187-5b89-4580-aead-548f2cf7a8f7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.680302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1009/2040] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:44 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:44.684290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae21be8-03f7-4705-88a5-9704fe1f91ea admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:44.696344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae21be8-03f7-4705-88a5-9704fe1f91ea admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:44.701831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab359d3-42b0-4c47-9105-c4dadab6a978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:44.702521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab359d3-42b0-4c47-9105-c4dadab6a978 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.702803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab359d3-42b0-4c47-9105-c4dadab6a978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.703429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab359d3-42b0-4c47-9105-c4dadab6a978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.704162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab359d3-42b0-4c47-9105-c4dadab6a978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:44.705998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab359d3-42b0-4c47-9105-c4dadab6a978 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.718040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1032/2041] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:44.722668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbf187-5b89-4580-aead-548f2cf7a8f7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:44.732940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbf187-5b89-4580-aead-548f2cf7a8f7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:44.737936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e034b-1e2a-4fdb-9032-1618948a73d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:44.738832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e034b-1e2a-4fdb-9032-1618948a73d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.739114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e034b-1e2a-4fdb-9032-1618948a73d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.739390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e034b-1e2a-4fdb-9032-1618948a73d2 admin admin] PATH_INFO: `/v3/projects/7a96b579070347dcb0cc4bfc6249020f/users/e7978711ab98439eb40d5475e3b032b7/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.755651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e034b-1e2a-4fdb-9032-1618948a73d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a96b579070347dcb0cc4bfc6249020f, user_id=e7978711ab98439eb40d5475e3b032b7, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:44.758390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e034b-1e2a-4fdb-9032-1618948a73d2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.774539 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1010/2042] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:44 2022] PUT /identity/v3/projects/7a96b579070347dcb0cc4bfc6249020f/users/e7978711ab98439eb40d5475e3b032b7/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:44.778595 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab359d3-42b0-4c47-9105-c4dadab6a978 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:44.791493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab359d3-42b0-4c47-9105-c4dadab6a978 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:44.853839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d5258-e776-42a4-9d82-217931e292a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:44.854526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5258-e776-42a4-9d82-217931e292a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.854810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5258-e776-42a4-9d82-217931e292a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.855096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5258-e776-42a4-9d82-217931e292a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.855825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d5258-e776-42a4-9d82-217931e292a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:44.857488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d5258-e776-42a4-9d82-217931e292a9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.872111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1033/2043] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:44.873464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e034b-1e2a-4fdb-9032-1618948a73d2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:44.885101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e034b-1e2a-4fdb-9032-1618948a73d2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:44.890575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a649b6-f592-4e1d-95f0-a79a168c4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:44.891507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a649b6-f592-4e1d-95f0-a79a168c4d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.891786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a649b6-f592-4e1d-95f0-a79a168c4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.892059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a649b6-f592-4e1d-95f0-a79a168c4d41 admin admin] PATH_INFO: `/v3/projects/7a96b579070347dcb0cc4bfc6249020f/users/e7978711ab98439eb40d5475e3b032b7/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.894720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a649b6-f592-4e1d-95f0-a79a168c4d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a96b579070347dcb0cc4bfc6249020f, user_id=e7978711ab98439eb40d5475e3b032b7, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:44.897410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a649b6-f592-4e1d-95f0-a79a168c4d41 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:44.908621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1011/2044] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:44 2022] PUT /identity/v3/projects/7a96b579070347dcb0cc4bfc6249020f/users/e7978711ab98439eb40d5475e3b032b7/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:44.919353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80edd-57bc-498c-b3d0-8c1bc8bfcaf2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:44.919644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80edd-57bc-498c-b3d0-8c1bc8bfcaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:44.919920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80edd-57bc-498c-b3d0-8c1bc8bfcaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:44.948096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fbe80edd-57bc-498c-b3d0-8c1bc8bfcaf2 None None] MFA Rules not processed for user `e7978711ab98439eb40d5475e3b032b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:44.949351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fbe80edd-57bc-498c-b3d0-8c1bc8bfcaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:45.043596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1034/2045] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:45.055058 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a649b6-f592-4e1d-95f0-a79a168c4d41 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:45.057231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-88a649b6-f592-4e1d-95f0-a79a168c4d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:45.123609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a649b6-f592-4e1d-95f0-a79a168c4d41 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:45.127519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d907d6-44cb-4e57-af23-b3efcc2a8087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:45.128243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d907d6-44cb-4e57-af23-b3efcc2a8087 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:45.128438 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d907d6-44cb-4e57-af23-b3efcc2a8087 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:45.128716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d907d6-44cb-4e57-af23-b3efcc2a8087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:45.147648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d907d6-44cb-4e57-af23-b3efcc2a8087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:45.149110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d907d6-44cb-4e57-af23-b3efcc2a8087 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:45.158960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1012/2046] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:45.246103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe80edd-57bc-498c-b3d0-8c1bc8bfcaf2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:45.256473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe80edd-57bc-498c-b3d0-8c1bc8bfcaf2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:45.261755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726f7a-36a2-47a1-a92f-f204cd7793ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:45.262646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726f7a-36a2-47a1-a92f-f204cd7793ea service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:45.262940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726f7a-36a2-47a1-a92f-f204cd7793ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:45.263256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726f7a-36a2-47a1-a92f-f204cd7793ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:45.317534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:45.329614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9726f7a-36a2-47a1-a92f-f204cd7793ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:45.332152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9726f7a-36a2-47a1-a92f-f204cd7793ea service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:45.343242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1035/2047] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:49.226770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d907d6-44cb-4e57-af23-b3efcc2a8087 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:49.228420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6d907d6-44cb-4e57-af23-b3efcc2a8087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:49.249608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d907d6-44cb-4e57-af23-b3efcc2a8087 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:49.254135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950ff94-c0fd-4027-95ae-633f45effd2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:49.255009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ff94-c0fd-4027-95ae-633f45effd2f service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:49.255289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ff94-c0fd-4027-95ae-633f45effd2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:49.255557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ff94-c0fd-4027-95ae-633f45effd2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:49.257440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d950ff94-c0fd-4027-95ae-633f45effd2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:49.322580 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:49.351117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950ff94-c0fd-4027-95ae-633f45effd2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:49.352310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950ff94-c0fd-4027-95ae-633f45effd2f service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:49.364551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1013/2048] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:50.789199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726f7a-36a2-47a1-a92f-f204cd7793ea service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:50.790951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f9726f7a-36a2-47a1-a92f-f204cd7793ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:50.823970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2a9cd-8e31-43c9-8d64-bb7bec92c9d2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:50.824617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2a9cd-8e31-43c9-8d64-bb7bec92c9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:50.824617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2a9cd-8e31-43c9-8d64-bb7bec92c9d2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:50.826350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1014/2049] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:13:50.862004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228558aa-a21b-4cd7-9cbe-d1a83b06a671 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:50.862293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228558aa-a21b-4cd7-9cbe-d1a83b06a671 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:50.862616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228558aa-a21b-4cd7-9cbe-d1a83b06a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:50.905650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-228558aa-a21b-4cd7-9cbe-d1a83b06a671 None None] MFA Rules not processed for user `328d0413dc65420c841b452f45c5b0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:50.907205 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-228558aa-a21b-4cd7-9cbe-d1a83b06a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:51.008488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726f7a-36a2-47a1-a92f-f204cd7793ea service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:51.021231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:51.023198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.024574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.024825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] PATH_INFO: `/v3/users/f83846c53e0e4972bdbca8e14b8267a2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.026955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83846c53e0e4972bdbca8e14b8267a2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:51.030250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:51.037109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1015/2050] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:13:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:51.038260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228558aa-a21b-4cd7-9cbe-d1a83b06a671 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:51.039590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-228558aa-a21b-4cd7-9cbe-d1a83b06a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:51.054466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228558aa-a21b-4cd7-9cbe-d1a83b06a671 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:51.060169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:51.061369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.061714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.062065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] PATH_INFO: `/v3/users/e54c15b29a374bc986040462451db2a1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.063679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54c15b29a374bc986040462451db2a1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:51.066407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:51.121192 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83846c53e0e4972bdbca8e14b8267a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.128778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83846c53e0e4972bdbca8e14b8267a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.129896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83846c53e0e4972bdbca8e14b8267a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.135993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54c15b29a374bc986040462451db2a1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.141047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83846c53e0e4972bdbca8e14b8267a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.142913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83846c53e0e4972bdbca8e14b8267a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.148427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54c15b29a374bc986040462451db2a1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.149518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54c15b29a374bc986040462451db2a1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.163792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54c15b29a374bc986040462451db2a1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.187956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1036/2051] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:50 2022] DELETE /identity/v3/users/f83846c53e0e4972bdbca8e14b8267a2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:51.187956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:51.187956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:51.188283 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a131413d-d4b0-4392-bba0-9b4368006f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54c15b29a374bc986040462451db2a1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.201267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1016/2052] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:51 2022] DELETE /identity/v3/users/e54c15b29a374bc986040462451db2a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:51.208496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c17d9-7c68-4f08-b84a-edacb645a018 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.208927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c17d9-7c68-4f08-b84a-edacb645a018 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.209326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c17d9-7c68-4f08-b84a-edacb645a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.236597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a72c17d9-7c68-4f08-b84a-edacb645a018 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:51.238196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a72c17d9-7c68-4f08-b84a-edacb645a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:51.342461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:51.369366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502be89-4e70-4b69-85c8-05c2971f1a71 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:51.379951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1017/2053] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:51.386671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:51.393198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c17d9-7c68-4f08-b84a-edacb645a018 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:51.394968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a72c17d9-7c68-4f08-b84a-edacb645a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:51.462770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f854b-4c49-4111-8af8-3a7893428260 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:51.463492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f854b-4c49-4111-8af8-3a7893428260 service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.464243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f854b-4c49-4111-8af8-3a7893428260 service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.464243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f854b-4c49-4111-8af8-3a7893428260 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.467021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-936f854b-4c49-4111-8af8-3a7893428260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:51.484292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f854b-4c49-4111-8af8-3a7893428260 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:51.486496 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f854b-4c49-4111-8af8-3a7893428260 service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:51.493676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c17d9-7c68-4f08-b84a-edacb645a018 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:51.497737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f6710-64ec-466d-8dcc-453c421309a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:51.498481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f6710-64ec-466d-8dcc-453c421309a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.498760 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f6710-64ec-466d-8dcc-453c421309a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.499037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f6710-64ec-466d-8dcc-453c421309a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.512151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f6710-64ec-466d-8dcc-453c421309a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:51.513859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1037/2054] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:51.514842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f6710-64ec-466d-8dcc-453c421309a6 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:51.530988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1018/2055] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:51.568350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f854b-4c49-4111-8af8-3a7893428260 service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:51.569807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-936f854b-4c49-4111-8af8-3a7893428260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:51.586337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f854b-4c49-4111-8af8-3a7893428260 service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:51.593105 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:51.593947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.594228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.594505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] PATH_INFO: `/v3/projects/88a7da351c07420e8995b68eb940f4e8` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.595727 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a7da351c07420e8995b68eb940f4e8)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:51.597728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:51.661960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a7da351c07420e8995b68eb940f4e8', 'request_id': 'req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.669164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a7da351c07420e8995b68eb940f4e8', 'request_id': 'req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.679384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a7da351c07420e8995b68eb940f4e8', 'request_id': 'req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.693919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] The token cache is being invalidate because project 88a7da351c07420e8995b68eb940f4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:51.694238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.695552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.697242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1038/2056] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:51 2022] DELETE /identity/v3/projects/88a7da351c07420e8995b68eb940f4e8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:51.703379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0cdac-4e3c-4cd7-8873-a9b9cd398c28 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.703677 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0cdac-4e3c-4cd7-8873-a9b9cd398c28 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.703968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0cdac-4e3c-4cd7-8873-a9b9cd398c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.731831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b4f0cdac-4e3c-4cd7-8873-a9b9cd398c28 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:51.733327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b4f0cdac-4e3c-4cd7-8873-a9b9cd398c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:51.756184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:51.757780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:51.825994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1019/2057] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:51.837498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d61a2-06d1-4870-8a13-7d58d83c9651 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.837948 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d61a2-06d1-4870-8a13-7d58d83c9651 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.838413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d61a2-06d1-4870-8a13-7d58d83c9651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.854315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c12cfb-e05a-4bd6-935a-909c895bdcc3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:51.861949 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:51.863378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.863937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.864477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] PATH_INFO: `/v3/users/3fce82a8b3984c6cb98ce444b2d97c63` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.866590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fce82a8b3984c6cb98ce444b2d97c63)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:51.868438 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-123d61a2-06d1-4870-8a13-7d58d83c9651 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:51.870265 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:51.870402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-123d61a2-06d1-4870-8a13-7d58d83c9651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:51.885384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1020/2058] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:51.889462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d61a2-06d1-4870-8a13-7d58d83c9651 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:51.899898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d61a2-06d1-4870-8a13-7d58d83c9651 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:51.906814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66b8fa-ccf5-4c42-9e00-cc597b8099cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:51.907596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66b8fa-ccf5-4c42-9e00-cc597b8099cf admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.907828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66b8fa-ccf5-4c42-9e00-cc597b8099cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.908099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66b8fa-ccf5-4c42-9e00-cc597b8099cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.908856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66b8fa-ccf5-4c42-9e00-cc597b8099cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:51.909251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66b8fa-ccf5-4c42-9e00-cc597b8099cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:51.911743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66b8fa-ccf5-4c42-9e00-cc597b8099cf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:51.914433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:51.928501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1021/2059] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:13:51.933034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66b8fa-ccf5-4c42-9e00-cc597b8099cf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:51.941471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fce82a8b3984c6cb98ce444b2d97c63'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.948233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66b8fa-ccf5-4c42-9e00-cc597b8099cf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:51.949467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fce82a8b3984c6cb98ce444b2d97c63'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.950209 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fce82a8b3984c6cb98ce444b2d97c63'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.959134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d72f-70d0-403f-88cf-fd2f4e52a4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:51.959903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d72f-70d0-403f-88cf-fd2f4e52a4dc admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:51.960284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d72f-70d0-403f-88cf-fd2f4e52a4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:51.960606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d72f-70d0-403f-88cf-fd2f4e52a4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:51.961287 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fce82a8b3984c6cb98ce444b2d97c63'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.961508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678d72f-70d0-403f-88cf-fd2f4e52a4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:51.962444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fce82a8b3984c6cb98ce444b2d97c63'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:51.963452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678d72f-70d0-403f-88cf-fd2f4e52a4dc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:51.986461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1039/2060] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:51 2022] DELETE /identity/v3/users/3fce82a8b3984c6cb98ce444b2d97c63 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:51.988203 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:51.989681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.005446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1022/2061] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:51 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:52.005446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd3773-0d2b-4d80-8510-f0360ad53080 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.005446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd3773-0d2b-4d80-8510-f0360ad53080 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.005446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd3773-0d2b-4d80-8510-f0360ad53080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.025240 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7abd3773-0d2b-4d80-8510-f0360ad53080 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:52.026466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7abd3773-0d2b-4d80-8510-f0360ad53080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.067195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e774a-8d55-4e81-9ebd-d68082ae5272 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.076207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:52.095856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1023/2062] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:52.096699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd3773-0d2b-4d80-8510-f0360ad53080 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.098078 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7abd3773-0d2b-4d80-8510-f0360ad53080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.113452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd3773-0d2b-4d80-8510-f0360ad53080 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.118811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30cb38-c9f5-43ee-aadf-405f863b28f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.119594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30cb38-c9f5-43ee-aadf-405f863b28f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.119908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30cb38-c9f5-43ee-aadf-405f863b28f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.120188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30cb38-c9f5-43ee-aadf-405f863b28f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.121068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30cb38-c9f5-43ee-aadf-405f863b28f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.123197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30cb38-c9f5-43ee-aadf-405f863b28f4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.139612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.140600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.140881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.141304 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] PATH_INFO: `/v3/projects/65aa233dd0c444dfb52d78b83426d7e0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.142580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65aa233dd0c444dfb52d78b83426d7e0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.144624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.150284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1024/2063] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:52 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:52.151235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30cb38-c9f5-43ee-aadf-405f863b28f4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.153760 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0f30cb38-c9f5-43ee-aadf-405f863b28f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.201196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65aa233dd0c444dfb52d78b83426d7e0', 'request_id': 'req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:52.208205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65aa233dd0c444dfb52d78b83426d7e0', 'request_id': 'req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:52.210031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:52.218067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30cb38-c9f5-43ee-aadf-405f863b28f4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.218771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65aa233dd0c444dfb52d78b83426d7e0', 'request_id': 'req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:52.230686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] The token cache is being invalidate because project 65aa233dd0c444dfb52d78b83426d7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:52.231002 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:52.231649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:52.233261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1040/2064] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:51 2022] DELETE /identity/v3/projects/65aa233dd0c444dfb52d78b83426d7e0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:52.234014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.235300 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.273912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4002865-f205-4b38-8519-8e4614a9a3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.274600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4002865-f205-4b38-8519-8e4614a9a3fa service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.274885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4002865-f205-4b38-8519-8e4614a9a3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.275161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4002865-f205-4b38-8519-8e4614a9a3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.276991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f4002865-f205-4b38-8519-8e4614a9a3fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.298983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21e7b-e183-40b8-af2d-3cbd0dbff4d7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.304344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d3e37-2a0f-4e36-ba47-92e0dd31275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.305016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d3e37-2a0f-4e36-ba47-92e0dd31275a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.305329 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d3e37-2a0f-4e36-ba47-92e0dd31275a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.305607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d3e37-2a0f-4e36-ba47-92e0dd31275a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.306327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d3e37-2a0f-4e36-ba47-92e0dd31275a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.307923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d3e37-2a0f-4e36-ba47-92e0dd31275a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.317972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1041/2065] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:52.319040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8f2c3-0830-449e-b0b7-93951d911470 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.319327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8f2c3-0830-449e-b0b7-93951d911470 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.319602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8f2c3-0830-449e-b0b7-93951d911470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.338534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-51b8f2c3-0830-449e-b0b7-93951d911470 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:52.339735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-51b8f2c3-0830-449e-b0b7-93951d911470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.344030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4002865-f205-4b38-8519-8e4614a9a3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.345636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4002865-f205-4b38-8519-8e4614a9a3fa service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.347837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1042/2066] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:52.348613 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8f2c3-0830-449e-b0b7-93951d911470 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.358159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8f2c3-0830-449e-b0b7-93951d911470 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.361945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1025/2067] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:52.362816 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb760c1a-28fb-49e9-8dd3-92e312146d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.363532 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760c1a-28fb-49e9-8dd3-92e312146d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.363752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760c1a-28fb-49e9-8dd3-92e312146d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.363973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3be6a2-c529-445e-91cf-b735d8d9972b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.364079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760c1a-28fb-49e9-8dd3-92e312146d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.364371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3be6a2-c529-445e-91cf-b735d8d9972b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.364728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb760c1a-28fb-49e9-8dd3-92e312146d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.364830 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3be6a2-c529-445e-91cf-b735d8d9972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.366838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb760c1a-28fb-49e9-8dd3-92e312146d35 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.379146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1043/2068] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:52.383892 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb760c1a-28fb-49e9-8dd3-92e312146d35 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.384986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5a3be6a2-c529-445e-91cf-b735d8d9972b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:52.386306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5a3be6a2-c529-445e-91cf-b735d8d9972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.394969 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb760c1a-28fb-49e9-8dd3-92e312146d35 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.397116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1026/2069] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:52.399772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218734a-d0dc-4114-9656-d7c04fff67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.400725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218734a-d0dc-4114-9656-d7c04fff67bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.401077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218734a-d0dc-4114-9656-d7c04fff67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.401436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3be6a2-c529-445e-91cf-b735d8d9972b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.401536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218734a-d0dc-4114-9656-d7c04fff67bf admin admin] PATH_INFO: `/v3/projects/06a42c3c212c4704a777d31904787777/users/8f000c7588404b90ad8866e277aff46a/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.411316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3be6a2-c529-445e-91cf-b735d8d9972b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.416722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2f296-0b53-4fca-bd2c-4923cf560473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.417414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2f296-0b53-4fca-bd2c-4923cf560473 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.417759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2f296-0b53-4fca-bd2c-4923cf560473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.418358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2f296-0b53-4fca-bd2c-4923cf560473 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.418813 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2f296-0b53-4fca-bd2c-4923cf560473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:52.419121 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2f296-0b53-4fca-bd2c-4923cf560473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.419347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218734a-d0dc-4114-9656-d7c04fff67bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a42c3c212c4704a777d31904787777, user_id=8f000c7588404b90ad8866e277aff46a, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.421023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2f296-0b53-4fca-bd2c-4923cf560473 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.422215 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218734a-d0dc-4114-9656-d7c04fff67bf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.435446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1027/2070] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:52.439583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2f296-0b53-4fca-bd2c-4923cf560473 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.441266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1044/2071] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:52 2022] PUT /identity/v3/projects/06a42c3c212c4704a777d31904787777/users/8f000c7588404b90ad8866e277aff46a/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:52.450616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2f296-0b53-4fca-bd2c-4923cf560473 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.451413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed2a4-6bd4-4c35-a364-f5b1d384664a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.451737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed2a4-6bd4-4c35-a364-f5b1d384664a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.452024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed2a4-6bd4-4c35-a364-f5b1d384664a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.465717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:52.490103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e89ed2a4-6bd4-4c35-a364-f5b1d384664a None None] MFA Rules not processed for user `8f000c7588404b90ad8866e277aff46a`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:52.491467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e89ed2a4-6bd4-4c35-a364-f5b1d384664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.537000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959aede-f8b0-4820-9fb4-603a44cf99aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.537000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959aede-f8b0-4820-9fb4-603a44cf99aa admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.537000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959aede-f8b0-4820-9fb4-603a44cf99aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.537482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959aede-f8b0-4820-9fb4-603a44cf99aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.537830 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959aede-f8b0-4820-9fb4-603a44cf99aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.539900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959aede-f8b0-4820-9fb4-603a44cf99aa admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.592931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1028/2072] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:52 2022] POST /identity/v3/projects => generated 397 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:52.596966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1045/2073] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:52.597690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959aede-f8b0-4820-9fb4-603a44cf99aa admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.611386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed2a4-6bd4-4c35-a364-f5b1d384664a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.613339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e89ed2a4-6bd4-4c35-a364-f5b1d384664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.663280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:52.694465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959aede-f8b0-4820-9fb4-603a44cf99aa admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.694465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb822a5-7663-4757-ad14-0cc98e4964b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.694465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb822a5-7663-4757-ad14-0cc98e4964b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.694805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb822a5-7663-4757-ad14-0cc98e4964b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.694805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb822a5-7663-4757-ad14-0cc98e4964b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.695482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb822a5-7663-4757-ad14-0cc98e4964b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.697524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb822a5-7663-4757-ad14-0cc98e4964b9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.724027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed2a4-6bd4-4c35-a364-f5b1d384664a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.724999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1029/2074] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:52 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:52.729015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb822a5-7663-4757-ad14-0cc98e4964b9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.740938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb822a5-7663-4757-ad14-0cc98e4964b9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.746826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec2372-f229-4947-b3ab-53b992f4aebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.747495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec2372-f229-4947-b3ab-53b992f4aebc admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.747774 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec2372-f229-4947-b3ab-53b992f4aebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.748046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec2372-f229-4947-b3ab-53b992f4aebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.749738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec2372-f229-4947-b3ab-53b992f4aebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.751483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec2372-f229-4947-b3ab-53b992f4aebc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.767762 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1030/2075] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:52.769315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec2372-f229-4947-b3ab-53b992f4aebc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.789626 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec2372-f229-4947-b3ab-53b992f4aebc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.798179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce99d6-8aea-41ea-b294-1b35ce1de4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.799716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce99d6-8aea-41ea-b294-1b35ce1de4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.800410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce99d6-8aea-41ea-b294-1b35ce1de4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.800837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce99d6-8aea-41ea-b294-1b35ce1de4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.801826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce99d6-8aea-41ea-b294-1b35ce1de4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.804655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce99d6-8aea-41ea-b294-1b35ce1de4a4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.822595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1031/2076] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:52.823655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce99d6-8aea-41ea-b294-1b35ce1de4a4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.825170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2cc3a-7a67-441c-be7e-39da46f2405b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.825625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3dce99d6-8aea-41ea-b294-1b35ce1de4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:52.826134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2cc3a-7a67-441c-be7e-39da46f2405b service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.826422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2cc3a-7a67-441c-be7e-39da46f2405b service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.826726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2cc3a-7a67-441c-be7e-39da46f2405b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.843171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce99d6-8aea-41ea-b294-1b35ce1de4a4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.850500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:52.851387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:52.851640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:52.851912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] PATH_INFO: `/v3/projects/fb6fa249285a4b1894d231450acfa4a3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:52.853124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6fa249285a4b1894d231450acfa4a3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.855096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.902241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2cc3a-7a67-441c-be7e-39da46f2405b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:52.903765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2cc3a-7a67-441c-be7e-39da46f2405b service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:52.906213 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6fa249285a4b1894d231450acfa4a3', 'request_id': 'req-89d680d3-437b-47c7-ade7-0193a418b4ab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:52.912981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6fa249285a4b1894d231450acfa4a3', 'request_id': 'req-89d680d3-437b-47c7-ade7-0193a418b4ab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:52.913821 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1046/2077] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:52.914279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2cc3a-7a67-441c-be7e-39da46f2405b service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.924680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2cc3a-7a67-441c-be7e-39da46f2405b service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:52.924832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6fa249285a4b1894d231450acfa4a3', 'request_id': 'req-89d680d3-437b-47c7-ade7-0193a418b4ab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:52.930021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:52.939907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] The token cache is being invalidate because project fb6fa249285a4b1894d231450acfa4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:52.940262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:52.941229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:52.943322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1032/2078] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:52 2022] DELETE /identity/v3/projects/fb6fa249285a4b1894d231450acfa4a3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:52.947562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:52.949296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:53.006291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e3e7d-bc9f-4a7a-aace-5c019803a7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:53.007962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3e7d-bc9f-4a7a-aace-5c019803a7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:53.008654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3e7d-bc9f-4a7a-aace-5c019803a7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:53.009103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3e7d-bc9f-4a7a-aace-5c019803a7fb admin admin] PATH_INFO: `/v3/projects/dcb15740726248d09590679ed867b44e/users/84e3b545689f46de9e9596b3cdf21728/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:53.013372 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:53.029410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d680d3-437b-47c7-ade7-0193a418b4ab admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:53.031303 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e3e7d-bc9f-4a7a-aace-5c019803a7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb15740726248d09590679ed867b44e, user_id=84e3b545689f46de9e9596b3cdf21728, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:53.034317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e3e7d-bc9f-4a7a-aace-5c019803a7fb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:53.035113 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:53.036127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:53.036495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:53.036843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] PATH_INFO: `/v3/users/e7978711ab98439eb40d5475e3b032b7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:53.038342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7978711ab98439eb40d5475e3b032b7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:53.040509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:53.056167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1047/2079] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:52 2022] PUT /identity/v3/projects/dcb15740726248d09590679ed867b44e/users/84e3b545689f46de9e9596b3cdf21728/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:53.067456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfb5dd-4355-4550-b59d-0a59cb460c59 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:53.068443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfb5dd-4355-4550-b59d-0a59cb460c59 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:53.070763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfb5dd-4355-4550-b59d-0a59cb460c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:53.108804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c6dfb5dd-4355-4550-b59d-0a59cb460c59 None None] MFA Rules not processed for user `84e3b545689f46de9e9596b3cdf21728`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:53.110152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c6dfb5dd-4355-4550-b59d-0a59cb460c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:53.119378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7978711ab98439eb40d5475e3b032b7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:53.130126 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7978711ab98439eb40d5475e3b032b7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:53.131029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7978711ab98439eb40d5475e3b032b7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:53.150156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7978711ab98439eb40d5475e3b032b7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:53.168020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7978711ab98439eb40d5475e3b032b7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:53.179187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1033/2080] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:52 2022] DELETE /identity/v3/users/e7978711ab98439eb40d5475e3b032b7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:53.209598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1048/2081] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:53.221872 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:53.223604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:53.315942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8def1d-63a5-4e0f-8e1c-b07a92c0ba42 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:53.320798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e4ff8-0477-4161-b709-14dbe2db0c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:53.321629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e4ff8-0477-4161-b709-14dbe2db0c79 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:53.321924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e4ff8-0477-4161-b709-14dbe2db0c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:53.322206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e4ff8-0477-4161-b709-14dbe2db0c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:53.361782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:53.419704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e4ff8-0477-4161-b709-14dbe2db0c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:53.421917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e4ff8-0477-4161-b709-14dbe2db0c79 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:53.436263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1034/2082] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:53.764726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfb5dd-4355-4550-b59d-0a59cb460c59 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:53.766213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c6dfb5dd-4355-4550-b59d-0a59cb460c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:53.871497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfb5dd-4355-4550-b59d-0a59cb460c59 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:53.937442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:53.938331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:53.938581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:53.938859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] PATH_INFO: `/v3/projects/7a96b579070347dcb0cc4bfc6249020f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:53.940091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a96b579070347dcb0cc4bfc6249020f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:53.942297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.002043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:54.034663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a96b579070347dcb0cc4bfc6249020f', 'request_id': 'req-9b1d4ddf-2648-4852-8439-3c20ed1f055e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:54.042350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a96b579070347dcb0cc4bfc6249020f', 'request_id': 'req-9b1d4ddf-2648-4852-8439-3c20ed1f055e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:54.053440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a96b579070347dcb0cc4bfc6249020f', 'request_id': 'req-9b1d4ddf-2648-4852-8439-3c20ed1f055e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:54.067200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] The token cache is being invalidate because project 7a96b579070347dcb0cc4bfc6249020f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:54.067702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:54.068438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9b1d4ddf-2648-4852-8439-3c20ed1f055e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:54.070326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1049/2083] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:53 2022] DELETE /identity/v3/projects/7a96b579070347dcb0cc4bfc6249020f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:54.075569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0e8bb-fd85-4990-82e8-e450577ebf86 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.078072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0e8bb-fd85-4990-82e8-e450577ebf86 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.078652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0e8bb-fd85-4990-82e8-e450577ebf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.100411 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-51a0e8bb-fd85-4990-82e8-e450577ebf86 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:54.101685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-51a0e8bb-fd85-4990-82e8-e450577ebf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:54.164144 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1035/2084] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:54.172435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3172c-a87b-4525-824e-0a62434e5750 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.172655 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3172c-a87b-4525-824e-0a62434e5750 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.172940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3172c-a87b-4525-824e-0a62434e5750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.192275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-16f3172c-a87b-4525-824e-0a62434e5750 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:54.193514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-16f3172c-a87b-4525-824e-0a62434e5750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:54.202228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1050/2085] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:54.208627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0e8bb-fd85-4990-82e8-e450577ebf86 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:54.223382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0e8bb-fd85-4990-82e8-e450577ebf86 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:54.228540 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50517630-ccbb-4e0f-be52-6c7a151c5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:54.229227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50517630-ccbb-4e0f-be52-6c7a151c5031 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.229514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50517630-ccbb-4e0f-be52-6c7a151c5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.229790 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50517630-ccbb-4e0f-be52-6c7a151c5031 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.230524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50517630-ccbb-4e0f-be52-6c7a151c5031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:54.230832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50517630-ccbb-4e0f-be52-6c7a151c5031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:54.232449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50517630-ccbb-4e0f-be52-6c7a151c5031 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.244517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1036/2086] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:54.249032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3172c-a87b-4525-824e-0a62434e5750 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:54.258737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3172c-a87b-4525-824e-0a62434e5750 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:54.263830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174844e7-382f-4c81-b347-a117d704e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:54.264483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174844e7-382f-4c81-b347-a117d704e1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.264759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174844e7-382f-4c81-b347-a117d704e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.265034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174844e7-382f-4c81-b347-a117d704e1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.265750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174844e7-382f-4c81-b347-a117d704e1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:54.267654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174844e7-382f-4c81-b347-a117d704e1d6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.296808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1051/2087] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:54 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:54.301052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50517630-ccbb-4e0f-be52-6c7a151c5031 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:54.311414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50517630-ccbb-4e0f-be52-6c7a151c5031 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:54.371858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd504d1d-6be2-45cd-9414-7a4091aa60a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:54.372531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd504d1d-6be2-45cd-9414-7a4091aa60a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.372809 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd504d1d-6be2-45cd-9414-7a4091aa60a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.373083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd504d1d-6be2-45cd-9414-7a4091aa60a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.373814 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd504d1d-6be2-45cd-9414-7a4091aa60a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:54.375753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd504d1d-6be2-45cd-9414-7a4091aa60a8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.398417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1037/2088] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:54 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:54.403503 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174844e7-382f-4c81-b347-a117d704e1d6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:54.416115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174844e7-382f-4c81-b347-a117d704e1d6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:54.421788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40459abc-410d-428d-8ad9-c49314b28753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:54.422594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40459abc-410d-428d-8ad9-c49314b28753 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.423908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40459abc-410d-428d-8ad9-c49314b28753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.424245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40459abc-410d-428d-8ad9-c49314b28753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.424998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40459abc-410d-428d-8ad9-c49314b28753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:54.426767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40459abc-410d-428d-8ad9-c49314b28753 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.438975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1052/2089] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:54.443682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd504d1d-6be2-45cd-9414-7a4091aa60a8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:54.461472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd504d1d-6be2-45cd-9414-7a4091aa60a8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:54.473321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e803c2-84ca-4d2a-84ce-97da1acd626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:54.474421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e803c2-84ca-4d2a-84ce-97da1acd626f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.474701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e803c2-84ca-4d2a-84ce-97da1acd626f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.474977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e803c2-84ca-4d2a-84ce-97da1acd626f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.475718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e803c2-84ca-4d2a-84ce-97da1acd626f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:54.477475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e803c2-84ca-4d2a-84ce-97da1acd626f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.491908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1038/2090] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:54.493365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40459abc-410d-428d-8ad9-c49314b28753 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:54.504034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40459abc-410d-428d-8ad9-c49314b28753 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:54.509102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf757855-8ae8-44d9-b4de-ed77fc31fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:54.510035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf757855-8ae8-44d9-b4de-ed77fc31fbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.510320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf757855-8ae8-44d9-b4de-ed77fc31fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.510602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf757855-8ae8-44d9-b4de-ed77fc31fbd4 admin admin] PATH_INFO: `/v3/projects/81eb105dcc4745a9a60fb854920d0718/users/4dae6ab0412f44e7b5d7b92f71a075b6/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.550215 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf757855-8ae8-44d9-b4de-ed77fc31fbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81eb105dcc4745a9a60fb854920d0718, user_id=4dae6ab0412f44e7b5d7b92f71a075b6, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:54.553984 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf757855-8ae8-44d9-b4de-ed77fc31fbd4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.574455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1053/2091] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:54 2022] PUT /identity/v3/projects/81eb105dcc4745a9a60fb854920d0718/users/4dae6ab0412f44e7b5d7b92f71a075b6/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:54.587033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4785-a4c7-4833-8ddb-4f736e2c9d0e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.587366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4785-a4c7-4833-8ddb-4f736e2c9d0e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.587663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4785-a4c7-4833-8ddb-4f736e2c9d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.625879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f95a4785-a4c7-4833-8ddb-4f736e2c9d0e None None] MFA Rules not processed for user `4dae6ab0412f44e7b5d7b92f71a075b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:54.628650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f95a4785-a4c7-4833-8ddb-4f736e2c9d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:54.659371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:54.724554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1039/2092] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:54.729712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf757855-8ae8-44d9-b4de-ed77fc31fbd4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:54.808564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf757855-8ae8-44d9-b4de-ed77fc31fbd4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:54.813980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37716e81-a4eb-49a7-a4d2-6799c5ded32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:54.814639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716e81-a4eb-49a7-a4d2-6799c5ded32e admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.814917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716e81-a4eb-49a7-a4d2-6799c5ded32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.815189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716e81-a4eb-49a7-a4d2-6799c5ded32e admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.815916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37716e81-a4eb-49a7-a4d2-6799c5ded32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:54.818080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37716e81-a4eb-49a7-a4d2-6799c5ded32e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.846100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1054/2093] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:54 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:54.850688 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a4785-a4c7-4833-8ddb-4f736e2c9d0e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:54.862337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a4785-a4c7-4833-8ddb-4f736e2c9d0e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:54.924091 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8589d-ed70-4668-b4f6-429af8427e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:54.925076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8589d-ed70-4668-b4f6-429af8427e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.925633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8589d-ed70-4668-b4f6-429af8427e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.926214 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8589d-ed70-4668-b4f6-429af8427e74 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.927495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8589d-ed70-4668-b4f6-429af8427e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:54.930529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8589d-ed70-4668-b4f6-429af8427e74 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.957556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37716e81-a4eb-49a7-a4d2-6799c5ded32e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:54.959433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-37716e81-a4eb-49a7-a4d2-6799c5ded32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:54.959563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1040/2094] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:54 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:54.963272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8589d-ed70-4668-b4f6-429af8427e74 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:54.973091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37716e81-a4eb-49a7-a4d2-6799c5ded32e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:54.973575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8589d-ed70-4668-b4f6-429af8427e74 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:54.978028 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:54.978904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.979050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4a2eb-c2b7-40df-9aa0-1cc556fd983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:54.979157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.979437 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] PATH_INFO: `/v3/users/56019fbe8a4348c3a0e9d2b5f9fbed79` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.979545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4a2eb-c2b7-40df-9aa0-1cc556fd983f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:54.979836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4a2eb-c2b7-40df-9aa0-1cc556fd983f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:54.980108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4a2eb-c2b7-40df-9aa0-1cc556fd983f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:54.980656 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=56019fbe8a4348c3a0e9d2b5f9fbed79)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:54.980825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4a2eb-c2b7-40df-9aa0-1cc556fd983f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:54.982454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4a2eb-c2b7-40df-9aa0-1cc556fd983f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.982584 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:54.993589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1041/2095] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:54.997465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4a2eb-c2b7-40df-9aa0-1cc556fd983f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:55.008249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4a2eb-c2b7-40df-9aa0-1cc556fd983f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:55.013645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7750c4-556f-47f1-a62a-aa2770b86cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:55.014544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7750c4-556f-47f1-a62a-aa2770b86cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:55.014914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7750c4-556f-47f1-a62a-aa2770b86cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:55.015214 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7750c4-556f-47f1-a62a-aa2770b86cc9 admin admin] PATH_INFO: `/v3/projects/d85f42aeab0b41f49861bcc8b52292c0/users/8053304419af41ff8aed0862a15999d8/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:55.023738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:55.037431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7750c4-556f-47f1-a62a-aa2770b86cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85f42aeab0b41f49861bcc8b52292c0, user_id=8053304419af41ff8aed0862a15999d8, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:55.040568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7750c4-556f-47f1-a62a-aa2770b86cc9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:55.055094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56019fbe8a4348c3a0e9d2b5f9fbed79'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:55.060477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1042/2096] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:54 2022] PUT /identity/v3/projects/d85f42aeab0b41f49861bcc8b52292c0/users/8053304419af41ff8aed0862a15999d8/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:55.063246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56019fbe8a4348c3a0e9d2b5f9fbed79'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:55.064251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7750c4-556f-47f1-a62a-aa2770b86cc9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:55.064636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56019fbe8a4348c3a0e9d2b5f9fbed79'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:55.078103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56019fbe8a4348c3a0e9d2b5f9fbed79'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:55.079180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eaee9c12-958b-4c8d-a2e2-cc5b7adcf06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56019fbe8a4348c3a0e9d2b5f9fbed79'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:55.116528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1055/2097] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:54 2022] DELETE /identity/v3/users/56019fbe8a4348c3a0e9d2b5f9fbed79 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:55.118754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb1147-251a-463a-b0f7-b0e0b265fcb0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:55.119041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb1147-251a-463a-b0f7-b0e0b265fcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:55.119316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb1147-251a-463a-b0f7-b0e0b265fcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:55.137577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-eedb1147-251a-463a-b0f7-b0e0b265fcb0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:55.138792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-eedb1147-251a-463a-b0f7-b0e0b265fcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:55.165032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7750c4-556f-47f1-a62a-aa2770b86cc9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:55.198303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:55.229242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1056/2098] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:55.239454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb1147-251a-463a-b0f7-b0e0b265fcb0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:55.241140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-eedb1147-251a-463a-b0f7-b0e0b265fcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:55.261407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abeeb1-3225-4dc3-9bb4-9dc65587969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:55.262212 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abeeb1-3225-4dc3-9bb4-9dc65587969b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:55.262591 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abeeb1-3225-4dc3-9bb4-9dc65587969b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:55.262918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abeeb1-3225-4dc3-9bb4-9dc65587969b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:55.263943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abeeb1-3225-4dc3-9bb4-9dc65587969b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:55.265777 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abeeb1-3225-4dc3-9bb4-9dc65587969b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:55.283172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1043/2099] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:55.287412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abeeb1-3225-4dc3-9bb4-9dc65587969b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:55.289465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-21abeeb1-3225-4dc3-9bb4-9dc65587969b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:55.304085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abeeb1-3225-4dc3-9bb4-9dc65587969b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:55.311794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ee312-73d8-4ba4-80a1-27c116df705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:55.312922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee312-73d8-4ba4-80a1-27c116df705b admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:55.312922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee312-73d8-4ba4-80a1-27c116df705b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:55.313159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee312-73d8-4ba4-80a1-27c116df705b admin admin] PATH_INFO: `/v3/projects/d85f42aeab0b41f49861bcc8b52292c0/users/8053304419af41ff8aed0862a15999d8/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:55.315460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee312-73d8-4ba4-80a1-27c116df705b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85f42aeab0b41f49861bcc8b52292c0, user_id=8053304419af41ff8aed0862a15999d8, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:55.318666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee312-73d8-4ba4-80a1-27c116df705b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:55.350303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1044/2100] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:55 2022] PUT /identity/v3/projects/d85f42aeab0b41f49861bcc8b52292c0/users/8053304419af41ff8aed0862a15999d8/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:55.359010 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb1147-251a-463a-b0f7-b0e0b265fcb0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:55.360441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93bb24-86e6-4c19-9a6e-6c8577146a48 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:55.360804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93bb24-86e6-4c19-9a6e-6c8577146a48 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:55.361003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93bb24-86e6-4c19-9a6e-6c8577146a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:55.401027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4c93bb24-86e6-4c19-9a6e-6c8577146a48 None None] MFA Rules not processed for user `8053304419af41ff8aed0862a15999d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:55.402402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c93bb24-86e6-4c19-9a6e-6c8577146a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:55.441115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79044e5-b6d5-4858-ac7c-b5d7907cbf96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:55.441697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79044e5-b6d5-4858-ac7c-b5d7907cbf96 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:55.441979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79044e5-b6d5-4858-ac7c-b5d7907cbf96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:55.442248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79044e5-b6d5-4858-ac7c-b5d7907cbf96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:55.458661 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:55.491881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1045/2101] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:55.504847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93bb24-86e6-4c19-9a6e-6c8577146a48 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:55.506745 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c93bb24-86e6-4c19-9a6e-6c8577146a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:55.532758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79044e5-b6d5-4858-ac7c-b5d7907cbf96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:55.534427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79044e5-b6d5-4858-ac7c-b5d7907cbf96 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:55.545956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1057/2102] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:55.588006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93bb24-86e6-4c19-9a6e-6c8577146a48 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:55.592303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8544c-011e-4781-a581-f42ac567d670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:55.592661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8544c-011e-4781-a581-f42ac567d670 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:55.592981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8544c-011e-4781-a581-f42ac567d670 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:55.593270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8544c-011e-4781-a581-f42ac567d670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:55.604089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8544c-011e-4781-a581-f42ac567d670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:55.605650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8544c-011e-4781-a581-f42ac567d670 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:55.616456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1046/2103] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:55.885344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79044e5-b6d5-4858-ac7c-b5d7907cbf96 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:55.891207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e79044e5-b6d5-4858-ac7c-b5d7907cbf96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:55.955776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79044e5-b6d5-4858-ac7c-b5d7907cbf96 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:55.965099 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:55.966781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:55.967214 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:55.967786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] PATH_INFO: `/v3/projects/1aff0a255b704ef6a20b4c38d9f3c29d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:55.969493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aff0a255b704ef6a20b4c38d9f3c29d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:55.972073 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.038168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aff0a255b704ef6a20b4c38d9f3c29d', 'request_id': 'req-e3d0d803-1654-4205-9695-fa7b429525fa'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.044603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aff0a255b704ef6a20b4c38d9f3c29d', 'request_id': 'req-e3d0d803-1654-4205-9695-fa7b429525fa'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.053626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aff0a255b704ef6a20b4c38d9f3c29d', 'request_id': 'req-e3d0d803-1654-4205-9695-fa7b429525fa'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.066418 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] The token cache is being invalidate because project 1aff0a255b704ef6a20b4c38d9f3c29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:56.066706 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.067350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.069626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1058/2104] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:55 2022] DELETE /identity/v3/projects/1aff0a255b704ef6a20b4c38d9f3c29d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:56.074593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0270b3d-2555-4a68-a489-bfe5ccdb7ae8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.074879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0270b3d-2555-4a68-a489-bfe5ccdb7ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.075157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0270b3d-2555-4a68-a489-bfe5ccdb7ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.094785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d0270b3d-2555-4a68-a489-bfe5ccdb7ae8 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:56.096081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d0270b3d-2555-4a68-a489-bfe5ccdb7ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:56.102666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:56.104401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:56.130611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:56.161733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1047/2105] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:56.169360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f44f0-888d-4fe8-8ab9-7bb9fa26c78e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.170100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f44f0-888d-4fe8-8ab9-7bb9fa26c78e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.170100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f44f0-888d-4fe8-8ab9-7bb9fa26c78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.171292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0d803-1654-4205-9695-fa7b429525fa admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:56.176195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:56.177114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.177451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.177717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] PATH_INFO: `/v3/users/4dae6ab0412f44e7b5d7b92f71a075b6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.178926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dae6ab0412f44e7b5d7b92f71a075b6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:56.180943 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.189876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-894f44f0-888d-4fe8-8ab9-7bb9fa26c78e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:56.191295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-894f44f0-888d-4fe8-8ab9-7bb9fa26c78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:56.200149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1048/2106] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:56.204938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f44f0-888d-4fe8-8ab9-7bb9fa26c78e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:56.216480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f44f0-888d-4fe8-8ab9-7bb9fa26c78e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:56.222374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9ac3-dae1-4cb0-9e42-a3092bfcc4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:56.223264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9ac3-dae1-4cb0-9e42-a3092bfcc4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.223543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9ac3-dae1-4cb0-9e42-a3092bfcc4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.223840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9ac3-dae1-4cb0-9e42-a3092bfcc4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.225228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f9ac3-dae1-4cb0-9e42-a3092bfcc4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:56.225570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f9ac3-dae1-4cb0-9e42-a3092bfcc4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:56.225706 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:56.227223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f9ac3-dae1-4cb0-9e42-a3092bfcc4a4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.237556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dae6ab0412f44e7b5d7b92f71a075b6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.241845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1049/2107] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:56.245700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dae6ab0412f44e7b5d7b92f71a075b6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.246282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9ac3-dae1-4cb0-9e42-a3092bfcc4a4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:56.246443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dae6ab0412f44e7b5d7b92f71a075b6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.255432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dae6ab0412f44e7b5d7b92f71a075b6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.256189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a51b68d-08d3-41fd-bf8f-83ebd1d444e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dae6ab0412f44e7b5d7b92f71a075b6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.256893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9ac3-dae1-4cb0-9e42-a3092bfcc4a4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:56.262408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a3a5-18f5-4299-9c73-9583a4999f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:56.263258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a3a5-18f5-4299-9c73-9583a4999f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.263562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a3a5-18f5-4299-9c73-9583a4999f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.263835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a3a5-18f5-4299-9c73-9583a4999f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.264514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06a3a5-18f5-4299-9c73-9583a4999f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:56.266530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06a3a5-18f5-4299-9c73-9583a4999f9e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.275390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1059/2108] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:56 2022] DELETE /identity/v3/users/4dae6ab0412f44e7b5d7b92f71a075b6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:56.280166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aca5a-b845-4701-973c-dc95ec60f2b0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.280511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aca5a-b845-4701-973c-dc95ec60f2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.280798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aca5a-b845-4701-973c-dc95ec60f2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.295822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1050/2109] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:56 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:56.300039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a3a5-18f5-4299-9c73-9583a4999f9e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:56.301234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4d8aca5a-b845-4701-973c-dc95ec60f2b0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:56.302131 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ba06a3a5-18f5-4299-9c73-9583a4999f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:56.302825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4d8aca5a-b845-4701-973c-dc95ec60f2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:56.362141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1060/2110] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:56.368636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a3a5-18f5-4299-9c73-9583a4999f9e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:56.372411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aca5a-b845-4701-973c-dc95ec60f2b0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:56.373816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e60d11-87d6-40b1-9e3f-68b3a8e18832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:56.373975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4d8aca5a-b845-4701-973c-dc95ec60f2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:56.374476 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e60d11-87d6-40b1-9e3f-68b3a8e18832 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.374761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e60d11-87d6-40b1-9e3f-68b3a8e18832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.375031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e60d11-87d6-40b1-9e3f-68b3a8e18832 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.375732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e60d11-87d6-40b1-9e3f-68b3a8e18832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:56.377697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e60d11-87d6-40b1-9e3f-68b3a8e18832 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.399713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1051/2111] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:56 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:13:56.403714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e60d11-87d6-40b1-9e3f-68b3a8e18832 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:56.414758 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e60d11-87d6-40b1-9e3f-68b3a8e18832 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:56.419486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0f6b0-b3f2-4340-a9ff-5377a9974974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:56.420159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0f6b0-b3f2-4340-a9ff-5377a9974974 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.420459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0f6b0-b3f2-4340-a9ff-5377a9974974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.420766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0f6b0-b3f2-4340-a9ff-5377a9974974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.421527 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0f6b0-b3f2-4340-a9ff-5377a9974974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:56.423134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0f6b0-b3f2-4340-a9ff-5377a9974974 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.436179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1052/2112] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:56.440462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0f6b0-b3f2-4340-a9ff-5377a9974974 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:56.450861 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aca5a-b845-4701-973c-dc95ec60f2b0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:56.451071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0f6b0-b3f2-4340-a9ff-5377a9974974 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:56.455662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e27e1-c631-437f-9ccd-7813b13aa544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:56.456486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e27e1-c631-437f-9ccd-7813b13aa544 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.456591 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fa15f-9c4e-46d0-a64f-640941f53cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:56.456883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e27e1-c631-437f-9ccd-7813b13aa544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.457186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e27e1-c631-437f-9ccd-7813b13aa544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.457542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fa15f-9c4e-46d0-a64f-640941f53cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.457918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fa15f-9c4e-46d0-a64f-640941f53cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.458290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fa15f-9c4e-46d0-a64f-640941f53cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.459681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fa15f-9c4e-46d0-a64f-640941f53cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:56.460984 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fa15f-9c4e-46d0-a64f-640941f53cb6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.475501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e27e1-c631-437f-9ccd-7813b13aa544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:56.476343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1053/2113] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:13:56.477415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e27e1-c631-437f-9ccd-7813b13aa544 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.480495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fa15f-9c4e-46d0-a64f-640941f53cb6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:56.489288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1061/2114] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:56.490755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fa15f-9c4e-46d0-a64f-640941f53cb6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:56.495784 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a62a4a-d45f-4c23-b928-0055fe329c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:56.496670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a62a4a-d45f-4c23-b928-0055fe329c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.496947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a62a4a-d45f-4c23-b928-0055fe329c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.497235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a62a4a-d45f-4c23-b928-0055fe329c77 admin admin] PATH_INFO: `/v3/projects/8136045a01d148be8ce47b1c5cd61efa/users/49fa3328612c4d45a2d1e4e93f4da341/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.516561 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a62a4a-d45f-4c23-b928-0055fe329c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8136045a01d148be8ce47b1c5cd61efa, user_id=49fa3328612c4d45a2d1e4e93f4da341, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:56.520000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a62a4a-d45f-4c23-b928-0055fe329c77 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.542156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1054/2115] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:56 2022] PUT /identity/v3/projects/8136045a01d148be8ce47b1c5cd61efa/users/49fa3328612c4d45a2d1e4e93f4da341/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:56.554566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b3730-6490-4198-8f7e-1a605fc225b7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.554968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b3730-6490-4198-8f7e-1a605fc225b7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.555485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b3730-6490-4198-8f7e-1a605fc225b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.599796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e43b3730-6490-4198-8f7e-1a605fc225b7 None None] MFA Rules not processed for user `49fa3328612c4d45a2d1e4e93f4da341`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:56.601056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e43b3730-6490-4198-8f7e-1a605fc225b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:56.659699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:56.698497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1062/2116] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:56.710603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a62a4a-d45f-4c23-b928-0055fe329c77 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:56.713165 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b0a62a4a-d45f-4c23-b928-0055fe329c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:56.770120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:56.791215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a62a4a-d45f-4c23-b928-0055fe329c77 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:56.795218 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a4467-6306-46a1-8a7f-5687343067a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:56.795976 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a4467-6306-46a1-8a7f-5687343067a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.796651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a4467-6306-46a1-8a7f-5687343067a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.796997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a4467-6306-46a1-8a7f-5687343067a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.807313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a4467-6306-46a1-8a7f-5687343067a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:56.809016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a4467-6306-46a1-8a7f-5687343067a8 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.820089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b3730-6490-4198-8f7e-1a605fc225b7 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:56.821690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e43b3730-6490-4198-8f7e-1a605fc225b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:56.828884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1055/2117] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:56.897939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b3730-6490-4198-8f7e-1a605fc225b7 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:56.902757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:56.903880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:56.904277 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:56.904634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] PATH_INFO: `/v3/projects/81eb105dcc4745a9a60fb854920d0718` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:56.906108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=81eb105dcc4745a9a60fb854920d0718)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:56.908181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:56.960145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81eb105dcc4745a9a60fb854920d0718', 'request_id': 'req-acda5e07-f33f-443c-806d-2b31db450d4b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.966292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81eb105dcc4745a9a60fb854920d0718', 'request_id': 'req-acda5e07-f33f-443c-806d-2b31db450d4b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.974899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81eb105dcc4745a9a60fb854920d0718', 'request_id': 'req-acda5e07-f33f-443c-806d-2b31db450d4b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.987287 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] The token cache is being invalidate because project 81eb105dcc4745a9a60fb854920d0718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:56.987900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.988441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:56.990284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1063/2118] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:56 2022] DELETE /identity/v3/projects/81eb105dcc4745a9a60fb854920d0718 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:56.994104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a4467-6306-46a1-8a7f-5687343067a8 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:57.006635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a4467-6306-46a1-8a7f-5687343067a8 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:57.085842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:57.086876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:57.087183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:57.087466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] PATH_INFO: `/v3/users/8053304419af41ff8aed0862a15999d8` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:57.090450 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8053304419af41ff8aed0862a15999d8)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:57.093003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:57.166489 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8053304419af41ff8aed0862a15999d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:57.197881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8053304419af41ff8aed0862a15999d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:57.199421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8053304419af41ff8aed0862a15999d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:57.225264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8053304419af41ff8aed0862a15999d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:57.250184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6359857f-e0e9-4d88-acf7-3e68a99d25f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8053304419af41ff8aed0862a15999d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:57.258204 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1056/2119] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:56 2022] DELETE /identity/v3/users/8053304419af41ff8aed0862a15999d8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:57.544829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:57.546664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:57.562465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda5e07-f33f-443c-806d-2b31db450d4b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:57.629426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:57.630379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:57.630697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:57.630952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] PATH_INFO: `/v3/projects/d85f42aeab0b41f49861bcc8b52292c0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:57.632362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85f42aeab0b41f49861bcc8b52292c0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:57.634373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:57.657092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:57.689020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85f42aeab0b41f49861bcc8b52292c0', 'request_id': 'req-2d947574-8589-4c6d-96b9-d44720702fe1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:57.697496 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85f42aeab0b41f49861bcc8b52292c0', 'request_id': 'req-2d947574-8589-4c6d-96b9-d44720702fe1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:57.707336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85f42aeab0b41f49861bcc8b52292c0', 'request_id': 'req-2d947574-8589-4c6d-96b9-d44720702fe1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:57.719838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] The token cache is being invalidate because project d85f42aeab0b41f49861bcc8b52292c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:57.720141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:57.720743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2d947574-8589-4c6d-96b9-d44720702fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:57.722503 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1064/2120] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:57 2022] DELETE /identity/v3/projects/d85f42aeab0b41f49861bcc8b52292c0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:57.727725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6ef4c-cdc5-467b-ab0f-40ecbf9edc54 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:57.728401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6ef4c-cdc5-467b-ab0f-40ecbf9edc54 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:57.728401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6ef4c-cdc5-467b-ab0f-40ecbf9edc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:57.747822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-22c6ef4c-cdc5-467b-ab0f-40ecbf9edc54 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:57.749045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-22c6ef4c-cdc5-467b-ab0f-40ecbf9edc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:57.805675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:57.814282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1057/2121] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:57.824058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32090b-cb70-42a9-b0b5-685f92560fc8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:57.824341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32090b-cb70-42a9-b0b5-685f92560fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:57.824622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32090b-cb70-42a9-b0b5-685f92560fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:57.844448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8f32090b-cb70-42a9-b0b5-685f92560fc8 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:57.845730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8f32090b-cb70-42a9-b0b5-685f92560fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:57.856065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1065/2122] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:57.860657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6ef4c-cdc5-467b-ab0f-40ecbf9edc54 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:57.872137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6ef4c-cdc5-467b-ab0f-40ecbf9edc54 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:57.877512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d8f40-6eec-4e89-bfe4-ca2d4f4b98b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:57.878252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d8f40-6eec-4e89-bfe4-ca2d4f4b98b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:57.878669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d8f40-6eec-4e89-bfe4-ca2d4f4b98b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:57.878945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d8f40-6eec-4e89-bfe4-ca2d4f4b98b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:57.879707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d8f40-6eec-4e89-bfe4-ca2d4f4b98b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:57.880011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d8f40-6eec-4e89-bfe4-ca2d4f4b98b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:57.881679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d8f40-6eec-4e89-bfe4-ca2d4f4b98b8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:57.904160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1058/2123] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:13:57.905566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32090b-cb70-42a9-b0b5-685f92560fc8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:57.921029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32090b-cb70-42a9-b0b5-685f92560fc8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:57.926933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc59eef-ad51-4120-b4a4-d478c1fd16c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:57.927595 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc59eef-ad51-4120-b4a4-d478c1fd16c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:57.927871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc59eef-ad51-4120-b4a4-d478c1fd16c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:57.928151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc59eef-ad51-4120-b4a4-d478c1fd16c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:57.928849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc59eef-ad51-4120-b4a4-d478c1fd16c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:57.930869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc59eef-ad51-4120-b4a4-d478c1fd16c4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:57.962879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1066/2124] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:13:57 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:57.964632 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d8f40-6eec-4e89-bfe4-ca2d4f4b98b8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:57.976086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d8f40-6eec-4e89-bfe4-ca2d4f4b98b8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:58.035600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbb56d-553e-4b36-9a31-ca6a96c2c0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:58.036766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb56d-553e-4b36-9a31-ca6a96c2c0be admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.037256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb56d-553e-4b36-9a31-ca6a96c2c0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.037607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb56d-553e-4b36-9a31-ca6a96c2c0be admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.038596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbb56d-553e-4b36-9a31-ca6a96c2c0be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:58.041155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbb56d-553e-4b36-9a31-ca6a96c2c0be admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:58.067131 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1059/2125] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:13:57 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:13:58.071516 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc59eef-ad51-4120-b4a4-d478c1fd16c4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:58.083429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc59eef-ad51-4120-b4a4-d478c1fd16c4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:58.088997 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7ec55-3bca-47c6-8f8a-4951d6d64695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:58.089652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7ec55-3bca-47c6-8f8a-4951d6d64695 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.089937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7ec55-3bca-47c6-8f8a-4951d6d64695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.090217 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7ec55-3bca-47c6-8f8a-4951d6d64695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.090985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7ec55-3bca-47c6-8f8a-4951d6d64695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:58.092627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7ec55-3bca-47c6-8f8a-4951d6d64695 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:58.104466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1067/2126] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:58.108771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbb56d-553e-4b36-9a31-ca6a96c2c0be admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:58.120062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbb56d-553e-4b36-9a31-ca6a96c2c0be admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:58.124908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b74bc-2ff4-4fa3-adb1-d99060022860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:58.125619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b74bc-2ff4-4fa3-adb1-d99060022860 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.126015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b74bc-2ff4-4fa3-adb1-d99060022860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.126325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b74bc-2ff4-4fa3-adb1-d99060022860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.127236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b74bc-2ff4-4fa3-adb1-d99060022860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:58.129129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b74bc-2ff4-4fa3-adb1-d99060022860 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:58.140860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1060/2127] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:13:58.146180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7ec55-3bca-47c6-8f8a-4951d6d64695 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:58.161184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7ec55-3bca-47c6-8f8a-4951d6d64695 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:58.167351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa08cf-5d21-4aed-8e76-cf3c2d95b08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:58.167515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa08cf-5d21-4aed-8e76-cf3c2d95b08c admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.167748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa08cf-5d21-4aed-8e76-cf3c2d95b08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.167941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa08cf-5d21-4aed-8e76-cf3c2d95b08c admin admin] PATH_INFO: `/v3/projects/bf80b65b17f04cf4b1de9dd866b6088f/users/a0345d2ca3d64773ac449c815ce8f9db/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.185497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa08cf-5d21-4aed-8e76-cf3c2d95b08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf80b65b17f04cf4b1de9dd866b6088f, user_id=a0345d2ca3d64773ac449c815ce8f9db, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:58.188469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa08cf-5d21-4aed-8e76-cf3c2d95b08c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:58.214564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1068/2128] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:13:58 2022] PUT /identity/v3/projects/bf80b65b17f04cf4b1de9dd866b6088f/users/a0345d2ca3d64773ac449c815ce8f9db/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:58.225935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f76c59-48f8-460d-b26a-76114f0ce1f9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.226492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f76c59-48f8-460d-b26a-76114f0ce1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.226492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f76c59-48f8-460d-b26a-76114f0ce1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.272786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b4f76c59-48f8-460d-b26a-76114f0ce1f9 None None] MFA Rules not processed for user `a0345d2ca3d64773ac449c815ce8f9db`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:58.287529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b4f76c59-48f8-460d-b26a-76114f0ce1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:58.381953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1061/2129] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:58.409315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa08cf-5d21-4aed-8e76-cf3c2d95b08c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:58.412224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6aaa08cf-5d21-4aed-8e76-cf3c2d95b08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:58.476509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa08cf-5d21-4aed-8e76-cf3c2d95b08c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:58.480458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730cd4-6a52-4ccd-9634-b24e5dcd2145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:58.481075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730cd4-6a52-4ccd-9634-b24e5dcd2145 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.481504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730cd4-6a52-4ccd-9634-b24e5dcd2145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.481782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730cd4-6a52-4ccd-9634-b24e5dcd2145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.491313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730cd4-6a52-4ccd-9634-b24e5dcd2145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:58.493449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730cd4-6a52-4ccd-9634-b24e5dcd2145 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:58.505802 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1069/2130] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:58.507895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f76c59-48f8-460d-b26a-76114f0ce1f9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:58.509507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b4f76c59-48f8-460d-b26a-76114f0ce1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:58.527475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730cd4-6a52-4ccd-9634-b24e5dcd2145 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:58.574634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:58.584130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f76c59-48f8-460d-b26a-76114f0ce1f9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:58.589719 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:58.589896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:58.590857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.591187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.591504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] PATH_INFO: `/v3/users/8f000c7588404b90ad8866e277aff46a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.592756 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f000c7588404b90ad8866e277aff46a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:58.594863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:58.606990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730cd4-6a52-4ccd-9634-b24e5dcd2145 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:58.611578 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:58.612457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.612882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.613414 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] PATH_INFO: `/v3/users/a0345d2ca3d64773ac449c815ce8f9db` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.614542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0345d2ca3d64773ac449c815ce8f9db)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:58.616587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:58.645860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f000c7588404b90ad8866e277aff46a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.653690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f000c7588404b90ad8866e277aff46a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.654382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f000c7588404b90ad8866e277aff46a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.662938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f000c7588404b90ad8866e277aff46a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.668033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0345d2ca3d64773ac449c815ce8f9db'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.676208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c3bcc3a7-29be-47cc-8fc0-cf09a0a33fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f000c7588404b90ad8866e277aff46a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.676376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0345d2ca3d64773ac449c815ce8f9db'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.677162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0345d2ca3d64773ac449c815ce8f9db'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.683301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1062/2131] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:58 2022] DELETE /identity/v3/users/8f000c7588404b90ad8866e277aff46a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:58.687657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0345d2ca3d64773ac449c815ce8f9db'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.687918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8f905-ba0a-4662-aa6e-3d4db6d4abf0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.688296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8f905-ba0a-4662-aa6e-3d4db6d4abf0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.688562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8f905-ba0a-4662-aa6e-3d4db6d4abf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.688927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fbda6adf-0bfe-4583-aff0-57762d6a90c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0345d2ca3d64773ac449c815ce8f9db'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.709359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c1a8f905-ba0a-4662-aa6e-3d4db6d4abf0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:58.710291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1070/2132] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:58 2022] DELETE /identity/v3/users/a0345d2ca3d64773ac449c815ce8f9db => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:58.710689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c1a8f905-ba0a-4662-aa6e-3d4db6d4abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:58.714757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4303-e2a8-4690-bec3-97b5ca9c881b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.715042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4303-e2a8-4690-bec3-97b5ca9c881b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.715316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4303-e2a8-4690-bec3-97b5ca9c881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.735500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f61c4303-e2a8-4690-bec3-97b5ca9c881b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:58.736758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f61c4303-e2a8-4690-bec3-97b5ca9c881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:58.782003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1063/2133] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:58.783152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8f905-ba0a-4662-aa6e-3d4db6d4abf0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:58.785071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c1a8f905-ba0a-4662-aa6e-3d4db6d4abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:58.797973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8f905-ba0a-4662-aa6e-3d4db6d4abf0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:58.805415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:58.806300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.806582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.806862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] PATH_INFO: `/v3/users/84e3b545689f46de9e9596b3cdf21728` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.808216 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e3b545689f46de9e9596b3cdf21728)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:58.810217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:58.815118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1071/2134] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:58.817346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4303-e2a8-4690-bec3-97b5ca9c881b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:58.817599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f61c4303-e2a8-4690-bec3-97b5ca9c881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:58.864747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e3b545689f46de9e9596b3cdf21728'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.872070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e3b545689f46de9e9596b3cdf21728'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.872742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e3b545689f46de9e9596b3cdf21728'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.877537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4303-e2a8-4690-bec3-97b5ca9c881b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:58.881199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e3b545689f46de9e9596b3cdf21728'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.881740 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acb917-40f5-4202-82ad-25bf07321ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:58.882426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acb917-40f5-4202-82ad-25bf07321ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.882874 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acb917-40f5-4202-82ad-25bf07321ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.883149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acb917-40f5-4202-82ad-25bf07321ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.887589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:58.893045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acb917-40f5-4202-82ad-25bf07321ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:58.895269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acb917-40f5-4202-82ad-25bf07321ec2 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:58.896726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e3b545689f46de9e9596b3cdf21728'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:58.903336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1064/2135] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:13:58 2022] DELETE /identity/v3/users/84e3b545689f46de9e9596b3cdf21728 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:58.904122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:58.905522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:58.908461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1072/2136] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:58.911035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1384f-0a22-4e6a-8a6e-83605b922030 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.911404 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1384f-0a22-4e6a-8a6e-83605b922030 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.911756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1384f-0a22-4e6a-8a6e-83605b922030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.930682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0dc1384f-0a22-4e6a-8a6e-83605b922030 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:58.931980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0dc1384f-0a22-4e6a-8a6e-83605b922030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:58.936295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:58.979224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4996c99-de03-41ef-80b9-c78bef24afd2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:58.983652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb54de0-01b0-445f-9f78-4352f1876c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:58.984505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb54de0-01b0-445f-9f78-4352f1876c3d service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:58.985955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb54de0-01b0-445f-9f78-4352f1876c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:58.986240 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb54de0-01b0-445f-9f78-4352f1876c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:58.989374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ceb54de0-01b0-445f-9f78-4352f1876c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:59.005984 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1073/2137] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:59.013141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1384f-0a22-4e6a-8a6e-83605b922030 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:59.014872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0dc1384f-0a22-4e6a-8a6e-83605b922030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:59.028814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1384f-0a22-4e6a-8a6e-83605b922030 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:59.032868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743a3c0-0931-4cd2-8f63-de80c548d9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:59.033884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743a3c0-0931-4cd2-8f63-de80c548d9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:59.034166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743a3c0-0931-4cd2-8f63-de80c548d9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:59.034587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743a3c0-0931-4cd2-8f63-de80c548d9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:59.047878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743a3c0-0931-4cd2-8f63-de80c548d9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:59.050349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743a3c0-0931-4cd2-8f63-de80c548d9d2 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:59.066932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1074/2138] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:13:59.109362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb54de0-01b0-445f-9f78-4352f1876c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:59.111272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb54de0-01b0-445f-9f78-4352f1876c3d service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:59.124577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1065/2139] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:13:59.290726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743a3c0-0931-4cd2-8f63-de80c548d9d2 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:59.292883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5743a3c0-0931-4cd2-8f63-de80c548d9d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:59.330757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743a3c0-0931-4cd2-8f63-de80c548d9d2 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:59.343989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:59.345202 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:59.346123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:59.346686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] PATH_INFO: `/v3/projects/06a42c3c212c4704a777d31904787777` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:59.348545 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a42c3c212c4704a777d31904787777)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:59.351384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:59.471602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb54de0-01b0-445f-9f78-4352f1876c3d service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:59.474191 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ceb54de0-01b0-445f-9f78-4352f1876c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:59.480597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a42c3c212c4704a777d31904787777', 'request_id': 'req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.492503 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a42c3c212c4704a777d31904787777', 'request_id': 'req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.495770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb54de0-01b0-445f-9f78-4352f1876c3d service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:59.526964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a42c3c212c4704a777d31904787777', 'request_id': 'req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.551918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] The token cache is being invalidate because project 06a42c3c212c4704a777d31904787777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:59.552214 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.557132 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c9705a1f-c29b-4457-8e5d-6a942cf95d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.562606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1075/2140] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:59 2022] DELETE /identity/v3/projects/06a42c3c212c4704a777d31904787777 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:59.568151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75960bdb-992a-4edd-a21c-3e351ff04e48 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:59.568432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75960bdb-992a-4edd-a21c-3e351ff04e48 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:59.568637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75960bdb-992a-4edd-a21c-3e351ff04e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:59.633721 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-75960bdb-992a-4edd-a21c-3e351ff04e48 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:59.636541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-75960bdb-992a-4edd-a21c-3e351ff04e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:59.666128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:59.669937 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:59.670436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:59.673090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] PATH_INFO: `/v3/projects/dcb15740726248d09590679ed867b44e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:59.687280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb15740726248d09590679ed867b44e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:59.687280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:59.763880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1076/2141] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:13:59.764933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75960bdb-992a-4edd-a21c-3e351ff04e48 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:59.766392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-75960bdb-992a-4edd-a21c-3e351ff04e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:59.779828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75960bdb-992a-4edd-a21c-3e351ff04e48 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:59.780048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:59.786916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb15740726248d09590679ed867b44e', 'request_id': 'req-b8af4ea3-bec8-4c0b-b988-22000e8413db'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.800382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb15740726248d09590679ed867b44e', 'request_id': 'req-b8af4ea3-bec8-4c0b-b988-22000e8413db'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.810391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb15740726248d09590679ed867b44e', 'request_id': 'req-b8af4ea3-bec8-4c0b-b988-22000e8413db'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.815236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:59.824128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] The token cache is being invalidate because project dcb15740726248d09590679ed867b44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:59.824416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.825058 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b8af4ea3-bec8-4c0b-b988-22000e8413db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.831593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1066/2142] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:59 2022] DELETE /identity/v3/projects/dcb15740726248d09590679ed867b44e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:13:59.833179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef30d7b-501d-48e5-bbeb-a3f233cdebac None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:59.833494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef30d7b-501d-48e5-bbeb-a3f233cdebac None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:59.833779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef30d7b-501d-48e5-bbeb-a3f233cdebac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:59.861762 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9ef30d7b-501d-48e5-bbeb-a3f233cdebac None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:59.864896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9ef30d7b-501d-48e5-bbeb-a3f233cdebac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:59.867597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:59.868929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:59.868929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:59.869231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] PATH_INFO: `/v3/projects/bf80b65b17f04cf4b1de9dd866b6088f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:59.870472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf80b65b17f04cf4b1de9dd866b6088f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:59.872366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:59.874734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1067/2143] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:59.876291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cdbb5-a4f7-44e5-aaf4-6b0f59a3a93f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:59.876975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cdbb5-a4f7-44e5-aaf4-6b0f59a3a93f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:59.877507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cdbb5-a4f7-44e5-aaf4-6b0f59a3a93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:59.902081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-747cdbb5-a4f7-44e5-aaf4-6b0f59a3a93f None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:59.903308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-747cdbb5-a4f7-44e5-aaf4-6b0f59a3a93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:59.912224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1068/2144] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:13:59.913192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cdbb5-a4f7-44e5-aaf4-6b0f59a3a93f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:13:59.924541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cdbb5-a4f7-44e5-aaf4-6b0f59a3a93f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:13:59.939581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf80b65b17f04cf4b1de9dd866b6088f', 'request_id': 'req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.946371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf80b65b17f04cf4b1de9dd866b6088f', 'request_id': 'req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.955765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf80b65b17f04cf4b1de9dd866b6088f', 'request_id': 'req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.967118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] The token cache is being invalidate because project bf80b65b17f04cf4b1de9dd866b6088f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:13:59.967407 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.968085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e9bb94c2-2bb8-434f-a54d-b93acd233ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:13:59.969718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1077/2145] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:13:59 2022] DELETE /identity/v3/projects/bf80b65b17f04cf4b1de9dd866b6088f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:13:59.973582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32629015-36c4-47f9-9d0a-fd6a4ee778f1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:59.973582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32629015-36c4-47f9-9d0a-fd6a4ee778f1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:59.973582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32629015-36c4-47f9-9d0a-fd6a4ee778f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:59.986844 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62f007-41b0-4300-a70b-bd3e48d9af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:13:59.987639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f007-41b0-4300-a70b-bd3e48d9af01 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:13:59.987925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f007-41b0-4300-a70b-bd3e48d9af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:13:59.988198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f007-41b0-4300-a70b-bd3e48d9af01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:13:59.988926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62f007-41b0-4300-a70b-bd3e48d9af01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:13:59.989255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62f007-41b0-4300-a70b-bd3e48d9af01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:13:59.989857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-32629015-36c4-47f9-9d0a-fd6a4ee778f1 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:13:59.990879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62f007-41b0-4300-a70b-bd3e48d9af01 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:13:59.991074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-32629015-36c4-47f9-9d0a-fd6a4ee778f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:13:59.999101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1078/2146] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:00.001401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a1bd-a91f-4400-8806-27dbb279d634 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.001401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a1bd-a91f-4400-8806-27dbb279d634 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.001401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a1bd-a91f-4400-8806-27dbb279d634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.006643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1069/2147] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:00.011082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62f007-41b0-4300-a70b-bd3e48d9af01 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.021425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a2f7a1bd-a91f-4400-8806-27dbb279d634 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:00.021916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62f007-41b0-4300-a70b-bd3e48d9af01 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.023045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a2f7a1bd-a91f-4400-8806-27dbb279d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:00.027340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdc75b-5fd5-4166-b0e4-8714652bd286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.028056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdc75b-5fd5-4166-b0e4-8714652bd286 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.028343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdc75b-5fd5-4166-b0e4-8714652bd286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.028616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdc75b-5fd5-4166-b0e4-8714652bd286 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.029400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdc75b-5fd5-4166-b0e4-8714652bd286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:00.029710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdc75b-5fd5-4166-b0e4-8714652bd286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.031392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdc75b-5fd5-4166-b0e4-8714652bd286 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.031578 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1079/2148] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:00.032394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7a1bd-a91f-4400-8806-27dbb279d634 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.033673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a2f7a1bd-a91f-4400-8806-27dbb279d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:00.046098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7a1bd-a91f-4400-8806-27dbb279d634 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.052637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1070/2149] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:00.052637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02d444-5bfb-4101-b866-3e511a57a3d7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.052637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02d444-5bfb-4101-b866-3e511a57a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.052637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02d444-5bfb-4101-b866-3e511a57a3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.053792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7ed91-4b09-4621-a4c1-595362354ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.054494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ed91-4b09-4621-a4c1-595362354ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.054796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ed91-4b09-4621-a4c1-595362354ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.055101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ed91-4b09-4621-a4c1-595362354ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.055798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7ed91-4b09-4621-a4c1-595362354ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.057800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7ed91-4b09-4621-a4c1-595362354ea2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.070547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fc02d444-5bfb-4101-b866-3e511a57a3d7 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:00.071809 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fc02d444-5bfb-4101-b866-3e511a57a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:00.081314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1071/2150] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:00.085766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02d444-5bfb-4101-b866-3e511a57a3d7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.089647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1080/2151] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:00.089647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7ed91-4b09-4621-a4c1-595362354ea2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.095878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02d444-5bfb-4101-b866-3e511a57a3d7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.149488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7ed91-4b09-4621-a4c1-595362354ea2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.152904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98fff4-51cc-437e-af15-20e414af3221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.153593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fff4-51cc-437e-af15-20e414af3221 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.153876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fff4-51cc-437e-af15-20e414af3221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.154151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fff4-51cc-437e-af15-20e414af3221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.154323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80032d-b3c8-4772-b524-c14150d7c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.154882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98fff4-51cc-437e-af15-20e414af3221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.154976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80032d-b3c8-4772-b524-c14150d7c2fb admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.155253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80032d-b3c8-4772-b524-c14150d7c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.155550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80032d-b3c8-4772-b524-c14150d7c2fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.156294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80032d-b3c8-4772-b524-c14150d7c2fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:00.156599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80032d-b3c8-4772-b524-c14150d7c2fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.156800 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98fff4-51cc-437e-af15-20e414af3221 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.158219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80032d-b3c8-4772-b524-c14150d7c2fb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.173612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1081/2152] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:00.173612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80032d-b3c8-4772-b524-c14150d7c2fb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.182400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80032d-b3c8-4772-b524-c14150d7c2fb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.185919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1072/2153] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:00.186648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98fff4-51cc-437e-af15-20e414af3221 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.190771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cccf99-39a6-490b-9e2d-5c25c89c10a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.191452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cccf99-39a6-490b-9e2d-5c25c89c10a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.191731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cccf99-39a6-490b-9e2d-5c25c89c10a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.192012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cccf99-39a6-490b-9e2d-5c25c89c10a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.192703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cccf99-39a6-490b-9e2d-5c25c89c10a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.194705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cccf99-39a6-490b-9e2d-5c25c89c10a0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.200335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:00.203357 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:00.223675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1082/2154] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/users => generated 291 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:00.223675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cccf99-39a6-490b-9e2d-5c25c89c10a0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.231472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cccf99-39a6-490b-9e2d-5c25c89c10a0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.254246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98fff4-51cc-437e-af15-20e414af3221 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.259777 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502729a0-5167-451d-ba8c-b7897c828adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.260449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502729a0-5167-451d-ba8c-b7897c828adf admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.260737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502729a0-5167-451d-ba8c-b7897c828adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.261015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502729a0-5167-451d-ba8c-b7897c828adf admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.261778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502729a0-5167-451d-ba8c-b7897c828adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.263772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502729a0-5167-451d-ba8c-b7897c828adf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.288927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af96212-fe75-4343-8ff1-0ad4c85843aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.289548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af96212-fe75-4343-8ff1-0ad4c85843aa admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.289835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af96212-fe75-4343-8ff1-0ad4c85843aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.290091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af96212-fe75-4343-8ff1-0ad4c85843aa admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.290776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af96212-fe75-4343-8ff1-0ad4c85843aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.292528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1073/2155] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:00.292770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af96212-fe75-4343-8ff1-0ad4c85843aa admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.293293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502729a0-5167-451d-ba8c-b7897c828adf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.317035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1083/2156] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:00.317945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af96212-fe75-4343-8ff1-0ad4c85843aa admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.328035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af96212-fe75-4343-8ff1-0ad4c85843aa admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.364366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502729a0-5167-451d-ba8c-b7897c828adf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.369469 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc4837-dee5-4ed8-a716-444b03912666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.370136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc4837-dee5-4ed8-a716-444b03912666 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.370412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc4837-dee5-4ed8-a716-444b03912666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.370757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc4837-dee5-4ed8-a716-444b03912666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.371407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc4837-dee5-4ed8-a716-444b03912666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.373061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc4837-dee5-4ed8-a716-444b03912666 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.383339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1074/2157] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:00.384153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc4837-dee5-4ed8-a716-444b03912666 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.385338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad68b4c-980d-46bc-90b7-0036fd8d84b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.386016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad68b4c-980d-46bc-90b7-0036fd8d84b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.386297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad68b4c-980d-46bc-90b7-0036fd8d84b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.386576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad68b4c-980d-46bc-90b7-0036fd8d84b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.387286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad68b4c-980d-46bc-90b7-0036fd8d84b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.389282 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad68b4c-980d-46bc-90b7-0036fd8d84b2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.394066 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc4837-dee5-4ed8-a716-444b03912666 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.398951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979d4a5-6310-4b8e-80d4-7f7bdeae8f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.399553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979d4a5-6310-4b8e-80d4-7f7bdeae8f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.399936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979d4a5-6310-4b8e-80d4-7f7bdeae8f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.400228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979d4a5-6310-4b8e-80d4-7f7bdeae8f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.401090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979d4a5-6310-4b8e-80d4-7f7bdeae8f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.403021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979d4a5-6310-4b8e-80d4-7f7bdeae8f8f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.411396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1084/2158] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:00.412510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad68b4c-980d-46bc-90b7-0036fd8d84b2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.414129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1075/2159] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:00.415692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979d4a5-6310-4b8e-80d4-7f7bdeae8f8f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.425560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979d4a5-6310-4b8e-80d4-7f7bdeae8f8f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.425714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad68b4c-980d-46bc-90b7-0036fd8d84b2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.430440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443604b-509d-447f-8687-81beada64a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.431100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443604b-509d-447f-8687-81beada64a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.431377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443604b-509d-447f-8687-81beada64a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.431646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443604b-509d-447f-8687-81beada64a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.432064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fc902-d3d9-4e97-885d-4b71dee11da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.432363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443604b-509d-447f-8687-81beada64a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.432734 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fc902-d3d9-4e97-885d-4b71dee11da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.433034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fc902-d3d9-4e97-885d-4b71dee11da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.433321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fc902-d3d9-4e97-885d-4b71dee11da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.433971 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443604b-509d-447f-8687-81beada64a7d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.434080 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fc902-d3d9-4e97-885d-4b71dee11da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.435716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fc902-d3d9-4e97-885d-4b71dee11da3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.445398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1076/2160] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:14:00.446041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443604b-509d-447f-8687-81beada64a7d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.450491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1085/2161] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:00.450491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fc902-d3d9-4e97-885d-4b71dee11da3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.456513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443604b-509d-447f-8687-81beada64a7d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.461526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fc902-d3d9-4e97-885d-4b71dee11da3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.461917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702c73a-27a5-41a5-9d21-615de1877c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.462643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702c73a-27a5-41a5-9d21-615de1877c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.462896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702c73a-27a5-41a5-9d21-615de1877c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.463166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702c73a-27a5-41a5-9d21-615de1877c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.463921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702c73a-27a5-41a5-9d21-615de1877c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.465707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702c73a-27a5-41a5-9d21-615de1877c8d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.466502 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972dc26-18a0-44c8-b73f-5936ea63e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.467145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972dc26-18a0-44c8-b73f-5936ea63e536 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.467417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972dc26-18a0-44c8-b73f-5936ea63e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.467677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972dc26-18a0-44c8-b73f-5936ea63e536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.468437 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972dc26-18a0-44c8-b73f-5936ea63e536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.470065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972dc26-18a0-44c8-b73f-5936ea63e536 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.476362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1077/2162] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:00.480651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702c73a-27a5-41a5-9d21-615de1877c8d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.484096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1086/2163] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:14:00.484096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972dc26-18a0-44c8-b73f-5936ea63e536 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.492126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972dc26-18a0-44c8-b73f-5936ea63e536 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.493258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702c73a-27a5-41a5-9d21-615de1877c8d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.496695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9499ccc-518c-4928-9da6-de28f79c82df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.497628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499ccc-518c-4928-9da6-de28f79c82df admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.497754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569c3d8-5394-49aa-a64a-a7c6e334c7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.497909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499ccc-518c-4928-9da6-de28f79c82df admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.498185 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499ccc-518c-4928-9da6-de28f79c82df admin admin] PATH_INFO: `/v3/projects/1b2b7a122ba0412197304bb4e4d97d70/users/e7f85468275442b48f2396aa56f7b5dd/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.498628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c3d8-5394-49aa-a64a-a7c6e334c7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.498902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c3d8-5394-49aa-a64a-a7c6e334c7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.499170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c3d8-5394-49aa-a64a-a7c6e334c7c4 admin admin] PATH_INFO: `/v3/projects/e583c1924f584c26836cf0d8f3c35032/users/df046de743284a2b9be7ad2778ca6125/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.513435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9499ccc-518c-4928-9da6-de28f79c82df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2b7a122ba0412197304bb4e4d97d70, user_id=e7f85468275442b48f2396aa56f7b5dd, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.514034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569c3d8-5394-49aa-a64a-a7c6e334c7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e583c1924f584c26836cf0d8f3c35032, user_id=df046de743284a2b9be7ad2778ca6125, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.516317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9499ccc-518c-4928-9da6-de28f79c82df admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.516656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569c3d8-5394-49aa-a64a-a7c6e334c7c4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.533618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1078/2164] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:00 2022] PUT /identity/v3/projects/e583c1924f584c26836cf0d8f3c35032/users/df046de743284a2b9be7ad2778ca6125/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:00.534435 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569c3d8-5394-49aa-a64a-a7c6e334c7c4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.537150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1087/2165] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:00 2022] PUT /identity/v3/projects/1b2b7a122ba0412197304bb4e4d97d70/users/e7f85468275442b48f2396aa56f7b5dd/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:00.542335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edcc15-7caa-4612-9571-e650ce287358 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.542461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edcc15-7caa-4612-9571-e650ce287358 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.542751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edcc15-7caa-4612-9571-e650ce287358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.562913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-87edcc15-7caa-4612-9571-e650ce287358 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:00.564269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-87edcc15-7caa-4612-9571-e650ce287358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:00.586806 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:00.588513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:00.614020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569c3d8-5394-49aa-a64a-a7c6e334c7c4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.632562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1088/2166] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:00.634249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b9865-883a-462b-a780-59e3eb5296fd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.634536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b9865-883a-462b-a780-59e3eb5296fd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.634810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b9865-883a-462b-a780-59e3eb5296fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.664058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c65b9865-883a-462b-a780-59e3eb5296fd None None] MFA Rules not processed for user `df046de743284a2b9be7ad2778ca6125`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:00.665621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c65b9865-883a-462b-a780-59e3eb5296fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:00.675968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57ff7b-c92c-4987-aa91-d04da4f6eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.676875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57ff7b-c92c-4987-aa91-d04da4f6eef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.677157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57ff7b-c92c-4987-aa91-d04da4f6eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.677468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57ff7b-c92c-4987-aa91-d04da4f6eef1 admin admin] PATH_INFO: `/v3/projects/6369c429d9704e5489d5e46c3eb4400e/users/561772f3a1424f65902ac7ee07356044/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.693127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57ff7b-c92c-4987-aa91-d04da4f6eef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6369c429d9704e5489d5e46c3eb4400e, user_id=561772f3a1424f65902ac7ee07356044, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.696335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57ff7b-c92c-4987-aa91-d04da4f6eef1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.712296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1079/2167] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:00 2022] PUT /identity/v3/projects/6369c429d9704e5489d5e46c3eb4400e/users/561772f3a1424f65902ac7ee07356044/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:00.715579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57ff7b-c92c-4987-aa91-d04da4f6eef1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.717428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f57ff7b-c92c-4987-aa91-d04da4f6eef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:00.749052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1089/2168] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:00.750251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2b193-9055-4533-bfd8-cf5a95df6715 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.750541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2b193-9055-4533-bfd8-cf5a95df6715 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.750880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2b193-9055-4533-bfd8-cf5a95df6715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.796012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57ff7b-c92c-4987-aa91-d04da4f6eef1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.798312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-55a2b193-9055-4533-bfd8-cf5a95df6715 None None] MFA Rules not processed for user `561772f3a1424f65902ac7ee07356044`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:00.800420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-55a2b193-9055-4533-bfd8-cf5a95df6715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:00.800532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd5696-d65a-4a3f-ab58-762dc668b6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.801234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5696-d65a-4a3f-ab58-762dc668b6ea service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.801627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5696-d65a-4a3f-ab58-762dc668b6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.802023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5696-d65a-4a3f-ab58-762dc668b6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.901195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd5696-d65a-4a3f-ab58-762dc668b6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.902880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd5696-d65a-4a3f-ab58-762dc668b6ea service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.907041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1090/2169] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:00.910330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2b193-9055-4533-bfd8-cf5a95df6715 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.922837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1080/2170] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:00.923100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2b193-9055-4533-bfd8-cf5a95df6715 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.924581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd5696-d65a-4a3f-ab58-762dc668b6ea service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.928489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0f98a-1d74-4850-9960-6f19768c487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.929163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0f98a-1d74-4850-9960-6f19768c487b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.929510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0f98a-1d74-4850-9960-6f19768c487b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.929790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0f98a-1d74-4850-9960-6f19768c487b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.930481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0f98a-1d74-4850-9960-6f19768c487b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.933515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0f98a-1d74-4850-9960-6f19768c487b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.936497 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd5696-d65a-4a3f-ab58-762dc668b6ea service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:00.944176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608873-47bf-4c86-9501-72ae1d0765af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:00.945182 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608873-47bf-4c86-9501-72ae1d0765af admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:00.945599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608873-47bf-4c86-9501-72ae1d0765af admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:00.945978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608873-47bf-4c86-9501-72ae1d0765af admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:00.946920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28608873-47bf-4c86-9501-72ae1d0765af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:00.949307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28608873-47bf-4c86-9501-72ae1d0765af admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:00.976275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1091/2171] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:00.977744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0f98a-1d74-4850-9960-6f19768c487b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:00.981424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:01.000418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1081/2172] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:01.005038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608873-47bf-4c86-9501-72ae1d0765af admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.046730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:01.102990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608873-47bf-4c86-9501-72ae1d0765af admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.117124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdab323-77d1-4aa9-bf21-1bebdd8ab990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.118019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab323-77d1-4aa9-bf21-1bebdd8ab990 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.118302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab323-77d1-4aa9-bf21-1bebdd8ab990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.118578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab323-77d1-4aa9-bf21-1bebdd8ab990 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.119291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdab323-77d1-4aa9-bf21-1bebdd8ab990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.121311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdab323-77d1-4aa9-bf21-1bebdd8ab990 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.129266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0f98a-1d74-4850-9960-6f19768c487b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.135917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f1bd-4119-4a79-ac7c-aab27a410b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.137281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f1bd-4119-4a79-ac7c-aab27a410b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.137671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f1bd-4119-4a79-ac7c-aab27a410b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.137953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f1bd-4119-4a79-ac7c-aab27a410b43 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.138663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4f1bd-4119-4a79-ac7c-aab27a410b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.141463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4f1bd-4119-4a79-ac7c-aab27a410b43 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.168234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1082/2173] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:01 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:01.170428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdab323-77d1-4aa9-bf21-1bebdd8ab990 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.176651 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1092/2174] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:00 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:01.178083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f1bd-4119-4a79-ac7c-aab27a410b43 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.191550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f1bd-4119-4a79-ac7c-aab27a410b43 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.193527 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdab323-77d1-4aa9-bf21-1bebdd8ab990 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.215264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01186ba-4f20-40e9-a059-55732bb5a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.216018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01186ba-4f20-40e9-a059-55732bb5a6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.216274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60edc5-925b-464a-b90f-931c4e2bc26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.216394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01186ba-4f20-40e9-a059-55732bb5a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.216551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01186ba-4f20-40e9-a059-55732bb5a6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.217072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60edc5-925b-464a-b90f-931c4e2bc26f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.217317 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60edc5-925b-464a-b90f-931c4e2bc26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.217415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01186ba-4f20-40e9-a059-55732bb5a6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.217592 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60edc5-925b-464a-b90f-931c4e2bc26f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.218985 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60edc5-925b-464a-b90f-931c4e2bc26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.220025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60edc5-925b-464a-b90f-931c4e2bc26f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.221330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01186ba-4f20-40e9-a059-55732bb5a6b6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.233573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1083/2175] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:14:01.240774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1093/2176] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:01.240943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60edc5-925b-464a-b90f-931c4e2bc26f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.241910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01186ba-4f20-40e9-a059-55732bb5a6b6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.249587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60edc5-925b-464a-b90f-931c4e2bc26f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.252386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01186ba-4f20-40e9-a059-55732bb5a6b6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.255623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e1764-a743-46ce-8777-3505eb044e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.255892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e1764-a743-46ce-8777-3505eb044e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.256324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e1764-a743-46ce-8777-3505eb044e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.256722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e1764-a743-46ce-8777-3505eb044e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.257558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e1764-a743-46ce-8777-3505eb044e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.258324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fcd6a-acd7-4d78-a499-44b4c72d5a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.259336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e1764-a743-46ce-8777-3505eb044e1d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.260044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fcd6a-acd7-4d78-a499-44b4c72d5a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.260519 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fcd6a-acd7-4d78-a499-44b4c72d5a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.261168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fcd6a-acd7-4d78-a499-44b4c72d5a42 admin admin] PATH_INFO: `/v3/projects/0af495ee185e4a0f9444301e32aaa906/users/ba6975f384b0470988363ae6a879a813/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.273381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1084/2177] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:01.277352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e1764-a743-46ce-8777-3505eb044e1d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.282868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fcd6a-acd7-4d78-a499-44b4c72d5a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af495ee185e4a0f9444301e32aaa906, user_id=ba6975f384b0470988363ae6a879a813, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.285775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fcd6a-acd7-4d78-a499-44b4c72d5a42 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.289761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e1764-a743-46ce-8777-3505eb044e1d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.295581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9ca9f-cec9-4ccb-ae3c-6c20f4daaa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.296661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9ca9f-cec9-4ccb-ae3c-6c20f4daaa95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.297300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9ca9f-cec9-4ccb-ae3c-6c20f4daaa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.297599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9ca9f-cec9-4ccb-ae3c-6c20f4daaa95 admin admin] PATH_INFO: `/v3/projects/38704e135b5b495fa251bd3d6c0af5f4/users/fabfa1083ec045e0b82300802b617d41/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.306604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1094/2178] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:01 2022] PUT /identity/v3/projects/0af495ee185e4a0f9444301e32aaa906/users/ba6975f384b0470988363ae6a879a813/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:14:01.310621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fcd6a-acd7-4d78-a499-44b4c72d5a42 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.318094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9ca9f-cec9-4ccb-ae3c-6c20f4daaa95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38704e135b5b495fa251bd3d6c0af5f4, user_id=fabfa1083ec045e0b82300802b617d41, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.321525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9ca9f-cec9-4ccb-ae3c-6c20f4daaa95 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.337886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1085/2179] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:01 2022] PUT /identity/v3/projects/38704e135b5b495fa251bd3d6c0af5f4/users/fabfa1083ec045e0b82300802b617d41/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:01.349434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67c1c-11d0-4c00-980d-802e6d368259 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.349750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67c1c-11d0-4c00-980d-802e6d368259 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.350291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67c1c-11d0-4c00-980d-802e6d368259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.380914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5db67c1c-11d0-4c00-980d-802e6d368259 None None] MFA Rules not processed for user `fabfa1083ec045e0b82300802b617d41`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:01.382627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5db67c1c-11d0-4c00-980d-802e6d368259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:01.401049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fcd6a-acd7-4d78-a499-44b4c72d5a42 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.471617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba459a-0476-4b65-a6cc-ca702b7ee7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.472755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba459a-0476-4b65-a6cc-ca702b7ee7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.473156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba459a-0476-4b65-a6cc-ca702b7ee7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.473570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba459a-0476-4b65-a6cc-ca702b7ee7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.474604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba459a-0476-4b65-a6cc-ca702b7ee7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.479749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba459a-0476-4b65-a6cc-ca702b7ee7e7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.479938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1086/2180] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:14:01.480873 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67c1c-11d0-4c00-980d-802e6d368259 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.493805 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1095/2181] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:14:01.494970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba459a-0476-4b65-a6cc-ca702b7ee7e7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.497355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67c1c-11d0-4c00-980d-802e6d368259 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.504731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503f0d4-9ecb-4891-ab93-2de37388bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.505522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f0d4-9ecb-4891-ab93-2de37388bac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.505807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f0d4-9ecb-4891-ab93-2de37388bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.506128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f0d4-9ecb-4891-ab93-2de37388bac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.507152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503f0d4-9ecb-4891-ab93-2de37388bac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.509335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503f0d4-9ecb-4891-ab93-2de37388bac1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.510295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba459a-0476-4b65-a6cc-ca702b7ee7e7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.516589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61724b-ef85-4406-aba4-f1a878f69727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.517936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61724b-ef85-4406-aba4-f1a878f69727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.518221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61724b-ef85-4406-aba4-f1a878f69727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.518501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61724b-ef85-4406-aba4-f1a878f69727 admin admin] PATH_INFO: `/v3/projects/0af495ee185e4a0f9444301e32aaa906/users/ba6975f384b0470988363ae6a879a813/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.523560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61724b-ef85-4406-aba4-f1a878f69727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af495ee185e4a0f9444301e32aaa906, user_id=ba6975f384b0470988363ae6a879a813, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.526736 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61724b-ef85-4406-aba4-f1a878f69727 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.543899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1087/2182] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:01 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:01.544082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1096/2183] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:01 2022] PUT /identity/v3/projects/0af495ee185e4a0f9444301e32aaa906/users/ba6975f384b0470988363ae6a879a813/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:01.546402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503f0d4-9ecb-4891-ab93-2de37388bac1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.553142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e3f00-a0ad-4ae6-9336-6ccd21375855 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.553381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e3f00-a0ad-4ae6-9336-6ccd21375855 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.554102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e3f00-a0ad-4ae6-9336-6ccd21375855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.560426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:01.567832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:01.587001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5a7e3f00-a0ad-4ae6-9336-6ccd21375855 None None] MFA Rules not processed for user `ba6975f384b0470988363ae6a879a813`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:01.588279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5a7e3f00-a0ad-4ae6-9336-6ccd21375855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:01.657085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503f0d4-9ecb-4891-ab93-2de37388bac1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.662738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0145dc-fe3b-42f0-adec-e0d11512c115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.663426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0145dc-fe3b-42f0-adec-e0d11512c115 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.663705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0145dc-fe3b-42f0-adec-e0d11512c115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.663976 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0145dc-fe3b-42f0-adec-e0d11512c115 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.664841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0145dc-fe3b-42f0-adec-e0d11512c115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.666834 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0145dc-fe3b-42f0-adec-e0d11512c115 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.698103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1097/2184] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:14:01.698679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1088/2185] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:01 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:14:01.705006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e3f00-a0ad-4ae6-9336-6ccd21375855 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.712332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0145dc-fe3b-42f0-adec-e0d11512c115 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.714373 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f0145dc-fe3b-42f0-adec-e0d11512c115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:01.721690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e3f00-a0ad-4ae6-9336-6ccd21375855 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.730086 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fba90-4b93-4ce2-b831-2dbedc376222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.731054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fba90-4b93-4ce2-b831-2dbedc376222 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.731402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fba90-4b93-4ce2-b831-2dbedc376222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.731804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fba90-4b93-4ce2-b831-2dbedc376222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.733719 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fba90-4b93-4ce2-b831-2dbedc376222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.734548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fba90-4b93-4ce2-b831-2dbedc376222 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.748686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1098/2186] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:14:01.754094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fba90-4b93-4ce2-b831-2dbedc376222 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.770974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fba90-4b93-4ce2-b831-2dbedc376222 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.789016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea11ac-7697-4e2f-8ec9-cafc05480ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.789016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea11ac-7697-4e2f-8ec9-cafc05480ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.789016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea11ac-7697-4e2f-8ec9-cafc05480ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.789016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea11ac-7697-4e2f-8ec9-cafc05480ac7 admin admin] PATH_INFO: `/v3/projects/0f1a423c4a4a4bde9da4275d2cb1d3e4/users/defb947db9c74ab7b3ba50a74ee1d05b/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.799318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0145dc-fe3b-42f0-adec-e0d11512c115 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.804571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68602f19-d00b-4025-a997-c857d68b558d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.805335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68602f19-d00b-4025-a997-c857d68b558d service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.805617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68602f19-d00b-4025-a997-c857d68b558d service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.805890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68602f19-d00b-4025-a997-c857d68b558d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.807139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea11ac-7697-4e2f-8ec9-cafc05480ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1a423c4a4a4bde9da4275d2cb1d3e4, user_id=defb947db9c74ab7b3ba50a74ee1d05b, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.810156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea11ac-7697-4e2f-8ec9-cafc05480ac7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.822427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68602f19-d00b-4025-a997-c857d68b558d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.824264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68602f19-d00b-4025-a997-c857d68b558d service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.833256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1099/2187] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:01 2022] PUT /identity/v3/projects/0f1a423c4a4a4bde9da4275d2cb1d3e4/users/defb947db9c74ab7b3ba50a74ee1d05b/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:14:01.837567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea11ac-7697-4e2f-8ec9-cafc05480ac7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:01.839695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1089/2188] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:14:01.963710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea11ac-7697-4e2f-8ec9-cafc05480ac7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:01.968529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6337c5b-cb07-4b55-a814-77f4be21bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:01.969382 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6337c5b-cb07-4b55-a814-77f4be21bebf admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:01.969716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6337c5b-cb07-4b55-a814-77f4be21bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:01.969996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6337c5b-cb07-4b55-a814-77f4be21bebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:01.970733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6337c5b-cb07-4b55-a814-77f4be21bebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:01.972443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6337c5b-cb07-4b55-a814-77f4be21bebf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:01.989246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1100/2189] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:14:01.990522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68602f19-d00b-4025-a997-c857d68b558d service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:02.002057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68602f19-d00b-4025-a997-c857d68b558d service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:02.019913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc0e2-ff77-4888-9b46-ccaf5ea9e4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:02.021423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc0e2-ff77-4888-9b46-ccaf5ea9e4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:02.021894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc0e2-ff77-4888-9b46-ccaf5ea9e4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:02.022436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc0e2-ff77-4888-9b46-ccaf5ea9e4e9 admin admin] PATH_INFO: `/v3/projects/0f1a423c4a4a4bde9da4275d2cb1d3e4/users/defb947db9c74ab7b3ba50a74ee1d05b/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:02.038231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc0e2-ff77-4888-9b46-ccaf5ea9e4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1a423c4a4a4bde9da4275d2cb1d3e4, user_id=defb947db9c74ab7b3ba50a74ee1d05b, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:02.044882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc0e2-ff77-4888-9b46-ccaf5ea9e4e9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:02.084411 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1090/2190] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:01 2022] PUT /identity/v3/projects/0f1a423c4a4a4bde9da4275d2cb1d3e4/users/defb947db9c74ab7b3ba50a74ee1d05b/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:02.094886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7de3bc-18f6-4315-ad1b-c3362c57bb24 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:02.095237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7de3bc-18f6-4315-ad1b-c3362c57bb24 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:02.095587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7de3bc-18f6-4315-ad1b-c3362c57bb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:02.133967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-eb7de3bc-18f6-4315-ad1b-c3362c57bb24 None None] MFA Rules not processed for user `defb947db9c74ab7b3ba50a74ee1d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:02.135737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-eb7de3bc-18f6-4315-ad1b-c3362c57bb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:02.223781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:02.291893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1101/2191] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:02.340258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc0e2-ff77-4888-9b46-ccaf5ea9e4e9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:02.342057 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7de3bc-18f6-4315-ad1b-c3362c57bb24 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:02.447593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7de3bc-18f6-4315-ad1b-c3362c57bb24 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:02.449649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc0e2-ff77-4888-9b46-ccaf5ea9e4e9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:02.457473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c53c0-bc10-4278-945b-3674393d2a3a tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba6975f384b0470988363ae6a879a813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af495ee185e4a0f9444301e32aaa906', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:02.458339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c53c0-bc10-4278-945b-3674393d2a3a tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:02.458689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c53c0-bc10-4278-945b-3674393d2a3a tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:02.458988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c53c0-bc10-4278-945b-3674393d2a3a tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:02.459801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c53c0-bc10-4278-945b-3674393d2a3a tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:02.460198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c53c0-bc10-4278-945b-3674393d2a3a tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:02.460944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac4697-2851-4a22-88e2-b7611164f96d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:02.461750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac4697-2851-4a22-88e2-b7611164f96d service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:02.461937 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c53c0-bc10-4278-945b-3674393d2a3a tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:02.462170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac4697-2851-4a22-88e2-b7611164f96d service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:02.462642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac4697-2851-4a22-88e2-b7611164f96d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:02.483869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1091/2192] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:02.484839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c53c0-bc10-4278-945b-3674393d2a3a tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:02.507942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c53c0-bc10-4278-945b-3674393d2a3a tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:02.523419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3d00e-030a-43f7-8e32-a799ad76d7b5 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba6975f384b0470988363ae6a879a813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af495ee185e4a0f9444301e32aaa906', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:02.524090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3d00e-030a-43f7-8e32-a799ad76d7b5 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:02.524380 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3d00e-030a-43f7-8e32-a799ad76d7b5 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:02.524749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3d00e-030a-43f7-8e32-a799ad76d7b5 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:02.525398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3d00e-030a-43f7-8e32-a799ad76d7b5 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:02.527327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3d00e-030a-43f7-8e32-a799ad76d7b5 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:02.590004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:02.597757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac4697-2851-4a22-88e2-b7611164f96d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:02.603964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1092/2193] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:02 2022] POST /identity/v3/projects => generated 355 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:02.606676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac4697-2851-4a22-88e2-b7611164f96d service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:02.610670 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3d00e-030a-43f7-8e32-a799ad76d7b5 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:02.642567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1102/2194] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:02.723607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3d00e-030a-43f7-8e32-a799ad76d7b5 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:02.731256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5f78e-fbc8-437e-9b85-bff2408a5d08 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba6975f384b0470988363ae6a879a813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af495ee185e4a0f9444301e32aaa906', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:02.732210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5f78e-fbc8-437e-9b85-bff2408a5d08 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:02.732713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5f78e-fbc8-437e-9b85-bff2408a5d08 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:02.733537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5f78e-fbc8-437e-9b85-bff2408a5d08 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:02.735632 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5f78e-fbc8-437e-9b85-bff2408a5d08 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:02.737685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5f78e-fbc8-437e-9b85-bff2408a5d08 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:02.741729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5f78e-fbc8-437e-9b85-bff2408a5d08 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:02.772270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1093/2195] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:14:02.844469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac4697-2851-4a22-88e2-b7611164f96d service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:02.862177 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac4697-2851-4a22-88e2-b7611164f96d service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:02.878809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba6975f384b0470988363ae6a879a813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af495ee185e4a0f9444301e32aaa906', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:02.881369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:02.882083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:02.883292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] PATH_INFO: `/v3/projects/1a07bffb4c52475b8d98ed5487e3feba` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:02.886926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1a07bffb4c52475b8d98ed5487e3feba)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:02.893736 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:03.014499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a07bffb4c52475b8d98ed5487e3feba', 'request_id': 'req-b1c0bf06-08a7-42f0-a54b-250586975eba'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:03.027275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a07bffb4c52475b8d98ed5487e3feba', 'request_id': 'req-b1c0bf06-08a7-42f0-a54b-250586975eba'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:03.041786 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a07bffb4c52475b8d98ed5487e3feba', 'request_id': 'req-b1c0bf06-08a7-42f0-a54b-250586975eba'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:03.069852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] The token cache is being invalidate because project 1a07bffb4c52475b8d98ed5487e3feba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:03.070981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:03.071927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1c0bf06-08a7-42f0-a54b-250586975eba tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:03.075386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1103/2196] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:02 2022] DELETE /identity/v3/projects/1a07bffb4c52475b8d98ed5487e3feba => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:03.474488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5f78e-fbc8-437e-9b85-bff2408a5d08 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:03.476297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-95b5f78e-fbc8-437e-9b85-bff2408a5d08 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:03.611578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5f78e-fbc8-437e-9b85-bff2408a5d08 tempest-VolumeQuotaClassesTest-302582970 tempest-VolumeQuotaClassesTest-302582970-project-admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:03.716495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:03.718438 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:03.719696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:03.720127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] PATH_INFO: `/v3/users/df046de743284a2b9be7ad2778ca6125` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:03.723896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df046de743284a2b9be7ad2778ca6125)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:03.725985 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:03.796279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:03.807354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df046de743284a2b9be7ad2778ca6125'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:03.817964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df046de743284a2b9be7ad2778ca6125'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:03.818865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df046de743284a2b9be7ad2778ca6125'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:03.829368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df046de743284a2b9be7ad2778ca6125'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:03.847540 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df046de743284a2b9be7ad2778ca6125'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:03.856464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1094/2197] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:03 2022] DELETE /identity/v3/users/df046de743284a2b9be7ad2778ca6125 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:03.861078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab03c7-3e6d-40a3-a12b-d71e44c38e1e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:03.861690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab03c7-3e6d-40a3-a12b-d71e44c38e1e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:03.861690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab03c7-3e6d-40a3-a12b-d71e44c38e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:03.890715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2eab03c7-3e6d-40a3-a12b-d71e44c38e1e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:03.892293 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2eab03c7-3e6d-40a3-a12b-d71e44c38e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:03.908074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:04.025155 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1104/2198] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:14:04.035768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:04.037916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:04.119371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75324e-2071-4312-b03d-4209e0f9c2b6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:04.124647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e7f2b-8069-4f3b-b730-ba5dc2eec8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:04.125731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7f2b-8069-4f3b-b730-ba5dc2eec8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:04.126164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7f2b-8069-4f3b-b730-ba5dc2eec8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:04.126578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7f2b-8069-4f3b-b730-ba5dc2eec8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:04.141289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e7f2b-8069-4f3b-b730-ba5dc2eec8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:04.143116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e7f2b-8069-4f3b-b730-ba5dc2eec8e4 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:04.156767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1095/2199] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:04.358546 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab03c7-3e6d-40a3-a12b-d71e44c38e1e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:04.361433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2eab03c7-3e6d-40a3-a12b-d71e44c38e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:04.428050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab03c7-3e6d-40a3-a12b-d71e44c38e1e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:04.432036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5054bd-e821-4e4d-a190-7e1b28ff9938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:04.432889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5054bd-e821-4e4d-a190-7e1b28ff9938 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:04.433182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5054bd-e821-4e4d-a190-7e1b28ff9938 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:04.433481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5054bd-e821-4e4d-a190-7e1b28ff9938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:04.435536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3e5054bd-e821-4e4d-a190-7e1b28ff9938 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:04.513000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5054bd-e821-4e4d-a190-7e1b28ff9938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:04.514828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5054bd-e821-4e4d-a190-7e1b28ff9938 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:04.529339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1105/2200] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:05.456922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e7f2b-8069-4f3b-b730-ba5dc2eec8e4 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:05.459407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-528e7f2b-8069-4f3b-b730-ba5dc2eec8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:05.499807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e7f2b-8069-4f3b-b730-ba5dc2eec8e4 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:05.508410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:05.509370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:05.509651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:05.509928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] PATH_INFO: `/v3/projects/e583c1924f584c26836cf0d8f3c35032` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:05.511138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e583c1924f584c26836cf0d8f3c35032)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:05.513422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:05.587841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5054bd-e821-4e4d-a190-7e1b28ff9938 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:05.591229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3e5054bd-e821-4e4d-a190-7e1b28ff9938 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:05.610601 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e583c1924f584c26836cf0d8f3c35032', 'request_id': 'req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:05.615622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5054bd-e821-4e4d-a190-7e1b28ff9938 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:05.624585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e583c1924f584c26836cf0d8f3c35032', 'request_id': 'req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:05.640091 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e583c1924f584c26836cf0d8f3c35032', 'request_id': 'req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:05.661863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] The token cache is being invalidate because project e583c1924f584c26836cf0d8f3c35032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:05.662206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:05.664037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:05.667983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1096/2201] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:05 2022] DELETE /identity/v3/projects/e583c1924f584c26836cf0d8f3c35032 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:05.672113 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:05.680969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:05.733386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a09d8-cc76-4ad8-951d-3641509b954b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:05.734056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a09d8-cc76-4ad8-951d-3641509b954b service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:05.734334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a09d8-cc76-4ad8-951d-3641509b954b service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:05.734609 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a09d8-cc76-4ad8-951d-3641509b954b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:05.742287 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6e0a09d8-cc76-4ad8-951d-3641509b954b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:05.799221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:05.805149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:05.827275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983bdbd-d3df-4b38-aca7-aeaec4b9a1ca admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:05.834368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:05.835494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:05.835844 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:05.836193 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] PATH_INFO: `/v3/users/ba6975f384b0470988363ae6a879a813` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:05.837680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6975f384b0470988363ae6a879a813)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:05.840345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:05.868995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a09d8-cc76-4ad8-951d-3641509b954b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:05.871328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a09d8-cc76-4ad8-951d-3641509b954b service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:05.897049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1106/2202] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:14:05.918011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6975f384b0470988363ae6a879a813'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:05.927542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6975f384b0470988363ae6a879a813'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:05.928481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6975f384b0470988363ae6a879a813'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:05.942810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6975f384b0470988363ae6a879a813'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:05.976992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-15f6d1d9-b5f0-450a-a1a6-1808b9d16e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6975f384b0470988363ae6a879a813'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:05.984051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1097/2203] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:05 2022] DELETE /identity/v3/users/ba6975f384b0470988363ae6a879a813 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:14:06.585233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a09d8-cc76-4ad8-951d-3641509b954b service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:06.600880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a09d8-cc76-4ad8-951d-3641509b954b service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:06.698646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:06.699593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:06.701489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:06.702029 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] PATH_INFO: `/v3/projects/0af495ee185e4a0f9444301e32aaa906` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:06.703833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af495ee185e4a0f9444301e32aaa906)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:06.708852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:06.808589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af495ee185e4a0f9444301e32aaa906', 'request_id': 'req-21cca89a-236d-4840-8874-33561f05b648'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:06.832228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af495ee185e4a0f9444301e32aaa906', 'request_id': 'req-21cca89a-236d-4840-8874-33561f05b648'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:06.856812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af495ee185e4a0f9444301e32aaa906', 'request_id': 'req-21cca89a-236d-4840-8874-33561f05b648'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:06.876521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] The token cache is being invalidate because project 0af495ee185e4a0f9444301e32aaa906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:06.877167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:06.878824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-21cca89a-236d-4840-8874-33561f05b648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:06.880911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1107/2204] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:06 2022] DELETE /identity/v3/projects/0af495ee185e4a0f9444301e32aaa906 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:06.886621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc73370-bbdf-455a-b3be-aca4662b7cd5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:06.887199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc73370-bbdf-455a-b3be-aca4662b7cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:06.887199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc73370-bbdf-455a-b3be-aca4662b7cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:06.920772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0cc73370-bbdf-455a-b3be-aca4662b7cd5 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:06.922280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0cc73370-bbdf-455a-b3be-aca4662b7cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:07.056449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1098/2205] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:07.069375 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f70a8-fe8b-48b9-b867-0397ecedf08b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.070645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f70a8-fe8b-48b9-b867-0397ecedf08b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.071393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f70a8-fe8b-48b9-b867-0397ecedf08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.117382 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-291f70a8-fe8b-48b9-b867-0397ecedf08b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:07.118999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-291f70a8-fe8b-48b9-b867-0397ecedf08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:07.130550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1108/2206] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:07.134930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc73370-bbdf-455a-b3be-aca4662b7cd5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:07.150763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc73370-bbdf-455a-b3be-aca4662b7cd5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:07.166629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e807f31-9a54-4f99-b861-0cad78ace59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:07.167589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e807f31-9a54-4f99-b861-0cad78ace59d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.167805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e807f31-9a54-4f99-b861-0cad78ace59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.169139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e807f31-9a54-4f99-b861-0cad78ace59d admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.169341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e807f31-9a54-4f99-b861-0cad78ace59d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:07.171215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e807f31-9a54-4f99-b861-0cad78ace59d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:07.172852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e807f31-9a54-4f99-b861-0cad78ace59d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:07.231267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1099/2207] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:07.234583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f70a8-fe8b-48b9-b867-0397ecedf08b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:07.235392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6309a-a688-40bd-804a-e011dd3d24c3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.235778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6309a-a688-40bd-804a-e011dd3d24c3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.236144 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6309a-a688-40bd-804a-e011dd3d24c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.246989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f70a8-fe8b-48b9-b867-0397ecedf08b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:07.263690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb7c06-135c-464f-854c-cc6691493796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:07.264412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb7c06-135c-464f-854c-cc6691493796 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.264698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb7c06-135c-464f-854c-cc6691493796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.264971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb7c06-135c-464f-854c-cc6691493796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.265739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb7c06-135c-464f-854c-cc6691493796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:07.271748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb7c06-135c-464f-854c-cc6691493796 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:07.314521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-61d6309a-a688-40bd-804a-e011dd3d24c3 None None] MFA Rules not processed for user `e7f85468275442b48f2396aa56f7b5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:07.316111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-61d6309a-a688-40bd-804a-e011dd3d24c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:07.342361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1109/2208] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:07 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:07.348637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb7c06-135c-464f-854c-cc6691493796 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:07.404047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:07.426006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:07.496372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1100/2209] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:07.497775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6309a-a688-40bd-804a-e011dd3d24c3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:07.502279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-61d6309a-a688-40bd-804a-e011dd3d24c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:07.505202 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb7c06-135c-464f-854c-cc6691493796 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:07.511926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f4a0-7260-4786-aea1-5ac882a3b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:07.512613 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f4a0-7260-4786-aea1-5ac882a3b924 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.512891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f4a0-7260-4786-aea1-5ac882a3b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.513227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f4a0-7260-4786-aea1-5ac882a3b924 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.513935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789f4a0-7260-4786-aea1-5ac882a3b924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:07.515886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789f4a0-7260-4786-aea1-5ac882a3b924 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:07.528797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6309a-a688-40bd-804a-e011dd3d24c3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:07.538699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0161df-101e-4935-94c1-73b1f9629a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:07.540310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0161df-101e-4935-94c1-73b1f9629a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.540978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0161df-101e-4935-94c1-73b1f9629a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.541778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0161df-101e-4935-94c1-73b1f9629a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.542989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0161df-101e-4935-94c1-73b1f9629a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:07.548190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0161df-101e-4935-94c1-73b1f9629a51 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:07.591399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1110/2210] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:07 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:07.595886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f4a0-7260-4786-aea1-5ac882a3b924 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:07.608268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1101/2211] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:07 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:07.613258 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0161df-101e-4935-94c1-73b1f9629a51 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:07.618138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f4a0-7260-4786-aea1-5ac882a3b924 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:07.744464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0161df-101e-4935-94c1-73b1f9629a51 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:07.750913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69447b-c4aa-4b6e-bf35-672d5c0139b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:07.751101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968580b-d84e-4bf9-b534-fca133025edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:07.751603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69447b-c4aa-4b6e-bf35-672d5c0139b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.751773 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968580b-d84e-4bf9-b534-fca133025edc admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.751932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69447b-c4aa-4b6e-bf35-672d5c0139b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.752109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968580b-d84e-4bf9-b534-fca133025edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.752289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69447b-c4aa-4b6e-bf35-672d5c0139b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.752443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968580b-d84e-4bf9-b534-fca133025edc admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.753296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69447b-c4aa-4b6e-bf35-672d5c0139b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:07.755255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69447b-c4aa-4b6e-bf35-672d5c0139b8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:07.755681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968580b-d84e-4bf9-b534-fca133025edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:07.757944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968580b-d84e-4bf9-b534-fca133025edc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:07.786527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1111/2212] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:14:07.791201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69447b-c4aa-4b6e-bf35-672d5c0139b8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:07.800694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1102/2213] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:07 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:14:07.806923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968580b-d84e-4bf9-b534-fca133025edc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:07.823851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69447b-c4aa-4b6e-bf35-672d5c0139b8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:07.834177 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b8894-1b56-4148-9f61-955aa05d8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:07.834918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b8894-1b56-4148-9f61-955aa05d8afa admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.835161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968580b-d84e-4bf9-b534-fca133025edc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:07.837177 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b8894-1b56-4148-9f61-955aa05d8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.838108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b8894-1b56-4148-9f61-955aa05d8afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.839276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b8894-1b56-4148-9f61-955aa05d8afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:07.844554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b8894-1b56-4148-9f61-955aa05d8afa admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:07.847223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d36cd7-8ed8-4852-9abc-1d60e2468063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:07.848309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d36cd7-8ed8-4852-9abc-1d60e2468063 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.848652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d36cd7-8ed8-4852-9abc-1d60e2468063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.849074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d36cd7-8ed8-4852-9abc-1d60e2468063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.860705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d36cd7-8ed8-4852-9abc-1d60e2468063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:07.863259 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d36cd7-8ed8-4852-9abc-1d60e2468063 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:07.875413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1112/2214] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:07.883758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b8894-1b56-4148-9f61-955aa05d8afa admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:07.885265 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1103/2215] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:07.890294 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d36cd7-8ed8-4852-9abc-1d60e2468063 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:07.907389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d36cd7-8ed8-4852-9abc-1d60e2468063 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:07.910748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b8894-1b56-4148-9f61-955aa05d8afa admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:07.916235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fdfb3-63a6-4aa5-98ec-9e70ab3d389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:07.917152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fdfb3-63a6-4aa5-98ec-9e70ab3d389e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.917462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fdfb3-63a6-4aa5-98ec-9e70ab3d389e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.917995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fdfb3-63a6-4aa5-98ec-9e70ab3d389e admin admin] PATH_INFO: `/v3/projects/928edba48d744dd6b3103e62b8c95765/users/b7d5117da4614c05b4a10a63119d60a9/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.930213 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966e86-d0b2-43b3-a203-989b6b544227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:07.931481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966e86-d0b2-43b3-a203-989b6b544227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.931764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966e86-d0b2-43b3-a203-989b6b544227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.932041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966e86-d0b2-43b3-a203-989b6b544227 admin admin] PATH_INFO: `/v3/projects/1ded13f6328646499f5c2d35c76f9619/users/1781ce47229f4b138e5296f666260119/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.946368 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fdfb3-63a6-4aa5-98ec-9e70ab3d389e admin admin] RBAC: Authorizing `identity:create_grant(project_id=928edba48d744dd6b3103e62b8c95765, user_id=b7d5117da4614c05b4a10a63119d60a9, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:07.949632 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fdfb3-63a6-4aa5-98ec-9e70ab3d389e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:07.953288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8966e86-d0b2-43b3-a203-989b6b544227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ded13f6328646499f5c2d35c76f9619, user_id=1781ce47229f4b138e5296f666260119, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:07.959954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8966e86-d0b2-43b3-a203-989b6b544227 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:07.976645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1113/2216] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:07 2022] PUT /identity/v3/projects/928edba48d744dd6b3103e62b8c95765/users/b7d5117da4614c05b4a10a63119d60a9/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:07.980356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1104/2217] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:07 2022] PUT /identity/v3/projects/1ded13f6328646499f5c2d35c76f9619/users/1781ce47229f4b138e5296f666260119/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:07.988767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c6acc-7c47-41d3-ad29-7a0982a2416c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:07.989054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c6acc-7c47-41d3-ad29-7a0982a2416c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:07.989363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c6acc-7c47-41d3-ad29-7a0982a2416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:07.990443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966e86-d0b2-43b3-a203-989b6b544227 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:08.024770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e91c6acc-7c47-41d3-ad29-7a0982a2416c None None] MFA Rules not processed for user `b7d5117da4614c05b4a10a63119d60a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:08.029948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e91c6acc-7c47-41d3-ad29-7a0982a2416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:08.073755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966e86-d0b2-43b3-a203-989b6b544227 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:08.089325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d863-ee9f-4d57-b928-8f045452926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:08.091196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d863-ee9f-4d57-b928-8f045452926a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:08.091660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d863-ee9f-4d57-b928-8f045452926a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:08.092786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d863-ee9f-4d57-b928-8f045452926a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:08.093749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929d863-ee9f-4d57-b928-8f045452926a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:08.095562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929d863-ee9f-4d57-b928-8f045452926a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:08.109481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1105/2218] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:08.114475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d863-ee9f-4d57-b928-8f045452926a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:08.122395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1114/2219] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:08.127714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c6acc-7c47-41d3-ad29-7a0982a2416c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:08.140199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d863-ee9f-4d57-b928-8f045452926a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:08.142386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:08.146669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd532f4e-6830-4940-90a9-be4e24526d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:08.148271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd532f4e-6830-4940-90a9-be4e24526d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:08.149188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd532f4e-6830-4940-90a9-be4e24526d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:08.149612 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd532f4e-6830-4940-90a9-be4e24526d72 admin admin] PATH_INFO: `/v3/projects/1ded13f6328646499f5c2d35c76f9619/users/1781ce47229f4b138e5296f666260119/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:08.152579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd532f4e-6830-4940-90a9-be4e24526d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ded13f6328646499f5c2d35c76f9619, user_id=1781ce47229f4b138e5296f666260119, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:08.155875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd532f4e-6830-4940-90a9-be4e24526d72 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:08.165607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c6acc-7c47-41d3-ad29-7a0982a2416c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:08.165825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:08.171886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49504e-d3fa-4ce8-ad21-95ca10059e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:08.172676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49504e-d3fa-4ce8-ad21-95ca10059e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:08.172960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49504e-d3fa-4ce8-ad21-95ca10059e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:08.173263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49504e-d3fa-4ce8-ad21-95ca10059e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:08.174034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49504e-d3fa-4ce8-ad21-95ca10059e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:08.178812 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1106/2220] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:08 2022] PUT /identity/v3/projects/1ded13f6328646499f5c2d35c76f9619/users/1781ce47229f4b138e5296f666260119/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:08.178930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49504e-d3fa-4ce8-ad21-95ca10059e17 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:08.215114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1115/2221] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:08 2022] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:08.220551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd532f4e-6830-4940-90a9-be4e24526d72 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:08.319719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd532f4e-6830-4940-90a9-be4e24526d72 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:08.335930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49504e-d3fa-4ce8-ad21-95ca10059e17 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:08.337274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3c49504e-d3fa-4ce8-ad21-95ca10059e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:08.451617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e18ad-897e-48c5-89f9-7e7e5de4acbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:08.452321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e18ad-897e-48c5-89f9-7e7e5de4acbb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:08.453067 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e18ad-897e-48c5-89f9-7e7e5de4acbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:08.453396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e18ad-897e-48c5-89f9-7e7e5de4acbb admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:08.454096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e18ad-897e-48c5-89f9-7e7e5de4acbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:08.456173 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e18ad-897e-48c5-89f9-7e7e5de4acbb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:08.483306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1107/2222] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:08 2022] POST /identity/v3/users => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:08.487780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e18ad-897e-48c5-89f9-7e7e5de4acbb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:08.500987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e18ad-897e-48c5-89f9-7e7e5de4acbb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:08.502498 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49504e-d3fa-4ce8-ad21-95ca10059e17 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:08.508066 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:08.508418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486249c0-4c66-43c9-8e71-be7241975fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:08.509104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:08.509256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486249c0-4c66-43c9-8e71-be7241975fae admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:08.509497 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486249c0-4c66-43c9-8e71-be7241975fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:08.509600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:08.509815 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486249c0-4c66-43c9-8e71-be7241975fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:08.509914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] PATH_INFO: `/v3/users/49fa3328612c4d45a2d1e4e93f4da341` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:08.510552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486249c0-4c66-43c9-8e71-be7241975fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:08.511095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49fa3328612c4d45a2d1e4e93f4da341)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:08.512388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486249c0-4c66-43c9-8e71-be7241975fae admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:08.513056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:08.525284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1108/2223] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:14:08.529485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486249c0-4c66-43c9-8e71-be7241975fae admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:08.557819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486249c0-4c66-43c9-8e71-be7241975fae admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:08.564622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc83bb-106e-40af-ac91-2ad4a03d950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:08.565837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc83bb-106e-40af-ac91-2ad4a03d950a admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:08.566325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc83bb-106e-40af-ac91-2ad4a03d950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:08.569555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc83bb-106e-40af-ac91-2ad4a03d950a admin admin] PATH_INFO: `/v3/projects/4081da58fa074b928bc8e128dfaa2722/users/1a28a7a9611946ec9348107920046a18/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:08.605451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc83bb-106e-40af-ac91-2ad4a03d950a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4081da58fa074b928bc8e128dfaa2722, user_id=1a28a7a9611946ec9348107920046a18, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:08.608812 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc83bb-106e-40af-ac91-2ad4a03d950a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:08.611912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49fa3328612c4d45a2d1e4e93f4da341'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:08.621667 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49fa3328612c4d45a2d1e4e93f4da341'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:08.622307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49fa3328612c4d45a2d1e4e93f4da341'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:08.630508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49fa3328612c4d45a2d1e4e93f4da341'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:08.631605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-842c86af-1550-48c0-b6b3-9d528671c5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49fa3328612c4d45a2d1e4e93f4da341'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:08.633127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1109/2224] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:08 2022] PUT /identity/v3/projects/4081da58fa074b928bc8e128dfaa2722/users/1a28a7a9611946ec9348107920046a18/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:08.635483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc83bb-106e-40af-ac91-2ad4a03d950a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:08.640062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-93dc83bb-106e-40af-ac91-2ad4a03d950a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:08.667035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1116/2225] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:08 2022] DELETE /identity/v3/users/49fa3328612c4d45a2d1e4e93f4da341 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:14:08.673867 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cbc5d-3ef4-4a77-be18-e2de05814132 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:08.674266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cbc5d-3ef4-4a77-be18-e2de05814132 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:08.674838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cbc5d-3ef4-4a77-be18-e2de05814132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:08.708269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-259cbc5d-3ef4-4a77-be18-e2de05814132 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:08.713428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-259cbc5d-3ef4-4a77-be18-e2de05814132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:08.841843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:08.851030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:08.853508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc83bb-106e-40af-ac91-2ad4a03d950a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:08.895553 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1117/2226] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:08.906513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cbc5d-3ef4-4a77-be18-e2de05814132 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:08.908391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-259cbc5d-3ef4-4a77-be18-e2de05814132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:08.981502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae7708-cb61-4b8f-8492-154534e74066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:08.982185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae7708-cb61-4b8f-8492-154534e74066 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:08.982463 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae7708-cb61-4b8f-8492-154534e74066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:08.982731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae7708-cb61-4b8f-8492-154534e74066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:08.983563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae7708-cb61-4b8f-8492-154534e74066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:08.985234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae7708-cb61-4b8f-8492-154534e74066 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:09.012986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1110/2227] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:09.018072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae7708-cb61-4b8f-8492-154534e74066 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:09.040333 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae7708-cb61-4b8f-8492-154534e74066 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:09.049639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7bf34-a8d3-4d86-b052-95a5321a80cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:09.052664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7bf34-a8d3-4d86-b052-95a5321a80cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:09.053371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7bf34-a8d3-4d86-b052-95a5321a80cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:09.053918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7bf34-a8d3-4d86-b052-95a5321a80cd admin admin] PATH_INFO: `/v3/projects/4081da58fa074b928bc8e128dfaa2722/users/1a28a7a9611946ec9348107920046a18/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:09.064057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7bf34-a8d3-4d86-b052-95a5321a80cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4081da58fa074b928bc8e128dfaa2722, user_id=1a28a7a9611946ec9348107920046a18, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:09.066361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cbc5d-3ef4-4a77-be18-e2de05814132 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:09.069141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7bf34-a8d3-4d86-b052-95a5321a80cd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:09.077060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b963b4-3540-4612-93d1-818bdba898d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:09.080385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b963b4-3540-4612-93d1-818bdba898d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:09.081909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b963b4-3540-4612-93d1-818bdba898d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:09.086564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b963b4-3540-4612-93d1-818bdba898d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:09.097256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1111/2228] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:09 2022] PUT /identity/v3/projects/4081da58fa074b928bc8e128dfaa2722/users/1a28a7a9611946ec9348107920046a18/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:09.112838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b963b4-3540-4612-93d1-818bdba898d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:09.115735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6723f-597e-4c95-b9c7-c320b49b72f1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:09.116212 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6723f-597e-4c95-b9c7-c320b49b72f1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:09.116589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6723f-597e-4c95-b9c7-c320b49b72f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:09.125579 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b963b4-3540-4612-93d1-818bdba898d8 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:09.151438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1118/2229] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:14:09.163134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e1c6723f-597e-4c95-b9c7-c320b49b72f1 None None] MFA Rules not processed for user `1a28a7a9611946ec9348107920046a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:09.166764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e1c6723f-597e-4c95-b9c7-c320b49b72f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:09.327882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1112/2230] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:14:09.348809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b963b4-3540-4612-93d1-818bdba898d8 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:09.353272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-11b963b4-3540-4612-93d1-818bdba898d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:09.458396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b963b4-3540-4612-93d1-818bdba898d8 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:09.538387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951db224-23a9-421b-a016-70ce6ecff1e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:09.539187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951db224-23a9-421b-a016-70ce6ecff1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:09.539330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951db224-23a9-421b-a016-70ce6ecff1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:09.539587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951db224-23a9-421b-a016-70ce6ecff1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:09.555098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951db224-23a9-421b-a016-70ce6ecff1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:09.556432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951db224-23a9-421b-a016-70ce6ecff1e7 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:09.573197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1119/2231] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:09.664185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6723f-597e-4c95-b9c7-c320b49b72f1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:09.666739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e1c6723f-597e-4c95-b9c7-c320b49b72f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:09.695569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6723f-597e-4c95-b9c7-c320b49b72f1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:09.716641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffee4f5-a746-464b-966e-4f1bce938374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:09.717836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffee4f5-a746-464b-966e-4f1bce938374 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:09.718360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffee4f5-a746-464b-966e-4f1bce938374 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:09.718799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffee4f5-a746-464b-966e-4f1bce938374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:09.722105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1ffee4f5-a746-464b-966e-4f1bce938374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:09.765984 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951db224-23a9-421b-a016-70ce6ecff1e7 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:09.767569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-951db224-23a9-421b-a016-70ce6ecff1e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:09.889747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951db224-23a9-421b-a016-70ce6ecff1e7 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:09.895470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:09.896658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:09.897153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:09.897676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] PATH_INFO: `/v3/projects/8136045a01d148be8ce47b1c5cd61efa` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:09.899459 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8136045a01d148be8ce47b1c5cd61efa)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:09.900899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffee4f5-a746-464b-966e-4f1bce938374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:09.902529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:09.903645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffee4f5-a746-464b-966e-4f1bce938374 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:09.905937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:09.932780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1113/2232] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:09.990513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8136045a01d148be8ce47b1c5cd61efa', 'request_id': 'req-9999b757-5c93-4331-a424-8ef67386b1c0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:10.008188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8136045a01d148be8ce47b1c5cd61efa', 'request_id': 'req-9999b757-5c93-4331-a424-8ef67386b1c0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:10.026768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8136045a01d148be8ce47b1c5cd61efa', 'request_id': 'req-9999b757-5c93-4331-a424-8ef67386b1c0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:10.065450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] The token cache is being invalidate because project 8136045a01d148be8ce47b1c5cd61efa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:10.066019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:10.067117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9999b757-5c93-4331-a424-8ef67386b1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:10.081863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1120/2233] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:09 2022] DELETE /identity/v3/projects/8136045a01d148be8ce47b1c5cd61efa => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:10.647205 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffee4f5-a746-464b-966e-4f1bce938374 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:10.649302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1ffee4f5-a746-464b-966e-4f1bce938374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:10.678680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffee4f5-a746-464b-966e-4f1bce938374 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:10.710882 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:10.849624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:10.853237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:10.853423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:10.853607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] PATH_INFO: `/v3/users/561772f3a1424f65902ac7ee07356044` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:10.858108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=561772f3a1424f65902ac7ee07356044)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:10.861628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:10.959765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561772f3a1424f65902ac7ee07356044'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:10.978127 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561772f3a1424f65902ac7ee07356044'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:10.980557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561772f3a1424f65902ac7ee07356044'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:10.996255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561772f3a1424f65902ac7ee07356044'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:11.030261 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561772f3a1424f65902ac7ee07356044'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:11.051132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1114/2234] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:10 2022] DELETE /identity/v3/users/561772f3a1424f65902ac7ee07356044 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:14:11.055843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde56b-5c55-4d77-979e-df2cc4edc3e7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:11.056344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde56b-5c55-4d77-979e-df2cc4edc3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:11.056436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde56b-5c55-4d77-979e-df2cc4edc3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:11.083970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-94bde56b-5c55-4d77-979e-df2cc4edc3e7 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:11.087383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-94bde56b-5c55-4d77-979e-df2cc4edc3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:11.214205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1121/2235] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:11.245864 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:11.248524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:11.338971 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e2e9b-a55e-4eee-9e8d-975a8bb88b5d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:11.343409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda312a3-49fe-43a3-a341-23b0c708b1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:11.345056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda312a3-49fe-43a3-a341-23b0c708b1cd service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:11.345504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda312a3-49fe-43a3-a341-23b0c708b1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:11.345914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda312a3-49fe-43a3-a341-23b0c708b1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:11.369542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda312a3-49fe-43a3-a341-23b0c708b1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:11.371050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda312a3-49fe-43a3-a341-23b0c708b1cd service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:11.394111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1115/2236] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:12.191674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bde56b-5c55-4d77-979e-df2cc4edc3e7 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:12.195708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-94bde56b-5c55-4d77-979e-df2cc4edc3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:12.222064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bde56b-5c55-4d77-979e-df2cc4edc3e7 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:12.231694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:12.232800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:12.233185 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:12.233714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] PATH_INFO: `/v3/projects/6369c429d9704e5489d5e46c3eb4400e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:12.239814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] RBAC: Authorizing `identity:delete_project(project_id=6369c429d9704e5489d5e46c3eb4400e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:12.242513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:12.339108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6369c429d9704e5489d5e46c3eb4400e', 'request_id': 'req-cff6e498-cf6b-47ed-9912-b46de8f0dcef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:12.349266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6369c429d9704e5489d5e46c3eb4400e', 'request_id': 'req-cff6e498-cf6b-47ed-9912-b46de8f0dcef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:12.364512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6369c429d9704e5489d5e46c3eb4400e', 'request_id': 'req-cff6e498-cf6b-47ed-9912-b46de8f0dcef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:12.399659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] The token cache is being invalidate because project 6369c429d9704e5489d5e46c3eb4400e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:12.399957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:12.400626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cff6e498-cf6b-47ed-9912-b46de8f0dcef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:12.405318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1122/2237] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:12 2022] DELETE /identity/v3/projects/6369c429d9704e5489d5e46c3eb4400e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:12.406713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda312a3-49fe-43a3-a341-23b0c708b1cd service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:12.417179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda312a3-49fe-43a3-a341-23b0c708b1cd service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:12.475522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:12.554822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:12.556046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:12.556395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:12.556739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] PATH_INFO: `/v3/users/fabfa1083ec045e0b82300802b617d41` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:12.558090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fabfa1083ec045e0b82300802b617d41)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:12.560107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:12.647579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fabfa1083ec045e0b82300802b617d41'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:12.658044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fabfa1083ec045e0b82300802b617d41'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:12.658888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fabfa1083ec045e0b82300802b617d41'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:12.668968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fabfa1083ec045e0b82300802b617d41'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:12.684999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3dbc2c41-c38f-4a6d-ac0a-d5c75bc18243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fabfa1083ec045e0b82300802b617d41'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:12.693524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1116/2238] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:12 2022] DELETE /identity/v3/users/fabfa1083ec045e0b82300802b617d41 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:14:12.724932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a6f5-c97d-4903-bed0-2653cdfe022f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:12.725460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a6f5-c97d-4903-bed0-2653cdfe022f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:12.725904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a6f5-c97d-4903-bed0-2653cdfe022f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:12.727681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1123/2239] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:14:12.763477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71af3a-4e85-4b48-a660-fd038502193e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:12.763835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71af3a-4e85-4b48-a660-fd038502193e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:12.764184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71af3a-4e85-4b48-a660-fd038502193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:12.801013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0e71af3a-4e85-4b48-a660-fd038502193e None None] MFA Rules not processed for user `328d0413dc65420c841b452f45c5b0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:12.805661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0e71af3a-4e85-4b48-a660-fd038502193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:12.972605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1117/2240] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:14:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:13.000853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3a6f5-c97d-4903-bed0-2653cdfe022f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:13.003979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d8d3a6f5-c97d-4903-bed0-2653cdfe022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:13.032895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3a6f5-c97d-4903-bed0-2653cdfe022f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:13.043169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e661ed-7576-43bf-b136-9ae6b193e89a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:13.044108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e661ed-7576-43bf-b136-9ae6b193e89a service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:13.044646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e661ed-7576-43bf-b136-9ae6b193e89a service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:13.045039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e661ed-7576-43bf-b136-9ae6b193e89a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:13.062742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e661ed-7576-43bf-b136-9ae6b193e89a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:13.064726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e661ed-7576-43bf-b136-9ae6b193e89a service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:13.089784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1124/2241] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:13.495806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71af3a-4e85-4b48-a660-fd038502193e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:13.497835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0e71af3a-4e85-4b48-a660-fd038502193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:13.617906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:13.647050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71af3a-4e85-4b48-a660-fd038502193e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:13.659601 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:13.660840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:13.661316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:13.661733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] PATH_INFO: `/v3/projects/38704e135b5b495fa251bd3d6c0af5f4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:13.663139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=38704e135b5b495fa251bd3d6c0af5f4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:13.665452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:13.743840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38704e135b5b495fa251bd3d6c0af5f4', 'request_id': 'req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:13.752992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38704e135b5b495fa251bd3d6c0af5f4', 'request_id': 'req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:13.771688 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38704e135b5b495fa251bd3d6c0af5f4', 'request_id': 'req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:13.816633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] The token cache is being invalidate because project 38704e135b5b495fa251bd3d6c0af5f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:13.816981 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:13.818048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:13.823343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1118/2242] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:13 2022] DELETE /identity/v3/projects/38704e135b5b495fa251bd3d6c0af5f4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:13.828874 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e661ed-7576-43bf-b136-9ae6b193e89a service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:13.836042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:13.848680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e661ed-7576-43bf-b136-9ae6b193e89a service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:13.937361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:13.939889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:13.979747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:13.981076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:13.981511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:13.981946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] PATH_INFO: `/v3/users/defb947db9c74ab7b3ba50a74ee1d05b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:13.983874 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=defb947db9c74ab7b3ba50a74ee1d05b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:13.986060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:14.068506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6d763-ea81-4d0c-847d-fa307bc9fe5a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:14.076258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defb947db9c74ab7b3ba50a74ee1d05b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.079738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:14.080661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:14.082222 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:14.082460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] PATH_INFO: `/v3/users/21edfc7452964ea9a7e4246727e38a55` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:14.084223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21edfc7452964ea9a7e4246727e38a55)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:14.086013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:14.095313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defb947db9c74ab7b3ba50a74ee1d05b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.096183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defb947db9c74ab7b3ba50a74ee1d05b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.115249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defb947db9c74ab7b3ba50a74ee1d05b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.116107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defb947db9c74ab7b3ba50a74ee1d05b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.165484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1125/2243] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:13 2022] DELETE /identity/v3/users/defb947db9c74ab7b3ba50a74ee1d05b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:14.209673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21edfc7452964ea9a7e4246727e38a55'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.236089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21edfc7452964ea9a7e4246727e38a55'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.239051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21edfc7452964ea9a7e4246727e38a55'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.249804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21edfc7452964ea9a7e4246727e38a55'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.269138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21edfc7452964ea9a7e4246727e38a55'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.271518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:14.288739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1119/2244] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:13 2022] DELETE /identity/v3/users/21edfc7452964ea9a7e4246727e38a55 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:14.391748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:14.394239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:14.494487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3aeb-00d2-4ea2-8cae-5b39ee6162ce admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:14.543032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:14.588554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:14.589388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:14.589676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:14.589958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] PATH_INFO: `/v3/users/b7d5117da4614c05b4a10a63119d60a9` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:14.591664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d5117da4614c05b4a10a63119d60a9)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:14.594371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:14.640653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:14.642124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:14.657332 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d5117da4614c05b4a10a63119d60a9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.666689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b50ca2-98fc-497c-9f73-e7f23892f648 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:14.669796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d5117da4614c05b4a10a63119d60a9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.670845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d5117da4614c05b4a10a63119d60a9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.679199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:14.680752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:14.680984 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:14.681353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] PATH_INFO: `/v3/projects/ae79d301b05f46fdbed7ef7e905ba064` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:14.682729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae79d301b05f46fdbed7ef7e905ba064)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:14.683625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d5117da4614c05b4a10a63119d60a9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.684253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2459a9f1-0ead-4dcb-8a23-4f96f25d0eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d5117da4614c05b4a10a63119d60a9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.685544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:14.716465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1126/2245] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:14 2022] DELETE /identity/v3/users/b7d5117da4614c05b4a10a63119d60a9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:14.720896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f0fd-76a0-4381-b62c-63d2d2e32c2e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:14.721223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f0fd-76a0-4381-b62c-63d2d2e32c2e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:14.721917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f0fd-76a0-4381-b62c-63d2d2e32c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:14.744513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d665f0fd-76a0-4381-b62c-63d2d2e32c2e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:14.746729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d665f0fd-76a0-4381-b62c-63d2d2e32c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:14.769154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae79d301b05f46fdbed7ef7e905ba064', 'request_id': 'req-645ff75c-d6b8-496d-8977-64cc4695a88d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.777957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae79d301b05f46fdbed7ef7e905ba064', 'request_id': 'req-645ff75c-d6b8-496d-8977-64cc4695a88d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.811300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae79d301b05f46fdbed7ef7e905ba064', 'request_id': 'req-645ff75c-d6b8-496d-8977-64cc4695a88d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.833469 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] The token cache is being invalidate because project ae79d301b05f46fdbed7ef7e905ba064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:14.833733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.834581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:14.839093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1120/2246] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:14 2022] DELETE /identity/v3/projects/ae79d301b05f46fdbed7ef7e905ba064 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:14:14.840405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:14.843353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:14.892643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1127/2247] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:14:14.908535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665f0fd-76a0-4381-b62c-63d2d2e32c2e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:14.911914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d665f0fd-76a0-4381-b62c-63d2d2e32c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:14.981181 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ff75c-d6b8-496d-8977-64cc4695a88d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:14.997369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:14.998323 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:14.998610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:14.998890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] PATH_INFO: `/v3/users/f6b653a3725446fca1169f7751234699` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.000737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b653a3725446fca1169f7751234699)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:15.001252 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:15.003245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:15.006817 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665f0fd-76a0-4381-b62c-63d2d2e32c2e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:15.081807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b653a3725446fca1169f7751234699'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.082936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd2c57-9b98-4e83-8301-2592875df648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:15.083941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2c57-9b98-4e83-8301-2592875df648 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:15.084486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2c57-9b98-4e83-8301-2592875df648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:15.085031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2c57-9b98-4e83-8301-2592875df648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.092445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b653a3725446fca1169f7751234699'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.093649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b653a3725446fca1169f7751234699'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.096412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd2c57-9b98-4e83-8301-2592875df648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:15.098224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd2c57-9b98-4e83-8301-2592875df648 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:15.108288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b653a3725446fca1169f7751234699'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.110488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1128/2248] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:15.111356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd2c57-9b98-4e83-8301-2592875df648 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:15.112870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8abd2c57-9b98-4e83-8301-2592875df648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:15.128973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd2c57-9b98-4e83-8301-2592875df648 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:15.134825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:15.136328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:15.136511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:15.136957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] PATH_INFO: `/v3/projects/0f1a423c4a4a4bde9da4275d2cb1d3e4` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.138409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1a423c4a4a4bde9da4275d2cb1d3e4)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:15.140904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:15.157377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b7b65465-ba3b-4107-98dc-6688a175b0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b653a3725446fca1169f7751234699'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.160201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:15.167467 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1121/2249] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:14 2022] DELETE /identity/v3/users/f6b653a3725446fca1169f7751234699 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:15.211559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1a423c4a4a4bde9da4275d2cb1d3e4', 'request_id': 'req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.222438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1a423c4a4a4bde9da4275d2cb1d3e4', 'request_id': 'req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.235111 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1a423c4a4a4bde9da4275d2cb1d3e4', 'request_id': 'req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.270101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] The token cache is being invalidate because project 0f1a423c4a4a4bde9da4275d2cb1d3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:15.270931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.273396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fcfc5363-3bda-42e2-92f6-f9678e8e2f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.276937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1129/2250] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:15 2022] DELETE /identity/v3/projects/0f1a423c4a4a4bde9da4275d2cb1d3e4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:15.283439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a005e6-f4ec-48bc-87a3-3e585edb5c74 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:15.283736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a005e6-f4ec-48bc-87a3-3e585edb5c74 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:15.284217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a005e6-f4ec-48bc-87a3-3e585edb5c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.328525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-12a005e6-f4ec-48bc-87a3-3e585edb5c74 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:15.335407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-12a005e6-f4ec-48bc-87a3-3e585edb5c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:15.420959 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1122/2251] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:15.429872 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e54d8c-ee9d-4e4b-9d03-791c50291c9d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:15.430225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e54d8c-ee9d-4e4b-9d03-791c50291c9d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:15.430508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e54d8c-ee9d-4e4b-9d03-791c50291c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.451951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-33e54d8c-ee9d-4e4b-9d03-791c50291c9d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:15.453738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-33e54d8c-ee9d-4e4b-9d03-791c50291c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:15.463101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1130/2252] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:15.467704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a005e6-f4ec-48bc-87a3-3e585edb5c74 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:15.480852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a005e6-f4ec-48bc-87a3-3e585edb5c74 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:15.486334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0a3c2-9584-4485-92fa-936320015d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:15.487101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0a3c2-9584-4485-92fa-936320015d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:15.487399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0a3c2-9584-4485-92fa-936320015d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:15.487729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0a3c2-9584-4485-92fa-936320015d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.488984 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0a3c2-9584-4485-92fa-936320015d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:15.489363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0a3c2-9584-4485-92fa-936320015d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:15.491438 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0a3c2-9584-4485-92fa-936320015d97 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:15.515307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e54d8c-ee9d-4e4b-9d03-791c50291c9d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:15.516244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-33e54d8c-ee9d-4e4b-9d03-791c50291c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:15.524616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1123/2253] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:15.525951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0a3c2-9584-4485-92fa-936320015d97 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:15.537249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e54d8c-ee9d-4e4b-9d03-791c50291c9d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:15.546365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0a3c2-9584-4485-92fa-936320015d97 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:15.550171 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:15.551363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:15.551558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:15.551819 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] PATH_INFO: `/v3/projects/928edba48d744dd6b3103e62b8c95765` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.553589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=928edba48d744dd6b3103e62b8c95765)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:15.555507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:15.560437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472010c-f600-4c40-a958-0be4ac7a8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:15.561115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472010c-f600-4c40-a958-0be4ac7a8cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:15.561454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472010c-f600-4c40-a958-0be4ac7a8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:15.561733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472010c-f600-4c40-a958-0be4ac7a8cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.562433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472010c-f600-4c40-a958-0be4ac7a8cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:15.564484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472010c-f600-4c40-a958-0be4ac7a8cfe admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:15.603718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1124/2254] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:15 2022] POST /identity/v3/projects => generated 363 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:15.609023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472010c-f600-4c40-a958-0be4ac7a8cfe admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:15.652965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928edba48d744dd6b3103e62b8c95765', 'request_id': 'req-02835f03-e943-4909-9460-3942925ce3d8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.661094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928edba48d744dd6b3103e62b8c95765', 'request_id': 'req-02835f03-e943-4909-9460-3942925ce3d8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.673819 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928edba48d744dd6b3103e62b8c95765', 'request_id': 'req-02835f03-e943-4909-9460-3942925ce3d8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.690735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] The token cache is being invalidate because project 928edba48d744dd6b3103e62b8c95765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:15.691187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.692504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.699166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1131/2255] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:15 2022] DELETE /identity/v3/projects/928edba48d744dd6b3103e62b8c95765 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:15.700175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:15.704004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:15.719070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:15.735884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472010c-f600-4c40-a958-0be4ac7a8cfe admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:15.850168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd38abb-51e1-4a75-9a80-2efbf7a25087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:15.850859 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd38abb-51e1-4a75-9a80-2efbf7a25087 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:15.851141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd38abb-51e1-4a75-9a80-2efbf7a25087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:15.851416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd38abb-51e1-4a75-9a80-2efbf7a25087 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.852112 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd38abb-51e1-4a75-9a80-2efbf7a25087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:15.854073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd38abb-51e1-4a75-9a80-2efbf7a25087 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:15.854356 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835f03-e943-4909-9460-3942925ce3d8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:15.859201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:15.860088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:15.860371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:15.860648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] PATH_INFO: `/v3/users/1a28a7a9611946ec9348107920046a18` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.862082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a28a7a9611946ec9348107920046a18)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:15.864259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:15.910685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1125/2256] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:15 2022] POST /identity/v3/users => generated 282 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:15.915287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd38abb-51e1-4a75-9a80-2efbf7a25087 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:15.922081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-edd38abb-51e1-4a75-9a80-2efbf7a25087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:15.935217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:15.936823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a28a7a9611946ec9348107920046a18'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.945047 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd38abb-51e1-4a75-9a80-2efbf7a25087 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:15.951225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a28a7a9611946ec9348107920046a18'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.951385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:15.951976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a28a7a9611946ec9348107920046a18'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.952280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:15.953317 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:15.953720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] PATH_INFO: `/v3/projects/4a548ad9f071466fb96ba349c919023e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:15.955282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a548ad9f071466fb96ba349c919023e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:15.958544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:15.963592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a28a7a9611946ec9348107920046a18'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:15.966940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a28a7a9611946ec9348107920046a18'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.014644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1132/2257] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:15 2022] DELETE /identity/v3/users/1a28a7a9611946ec9348107920046a18 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:16.015698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:16.019359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.038087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a548ad9f071466fb96ba349c919023e', 'request_id': 'req-8d1f1637-6690-497e-bd13-931418bb417a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.051514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a548ad9f071466fb96ba349c919023e', 'request_id': 'req-8d1f1637-6690-497e-bd13-931418bb417a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.070004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a548ad9f071466fb96ba349c919023e', 'request_id': 'req-8d1f1637-6690-497e-bd13-931418bb417a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.112858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] The token cache is being invalidate because project 4a548ad9f071466fb96ba349c919023e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:16.112858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.113350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8d1f1637-6690-497e-bd13-931418bb417a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.115769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1126/2258] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:15 2022] DELETE /identity/v3/projects/4a548ad9f071466fb96ba349c919023e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:16.132925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965040-9c74-48d2-ac42-13f0a1e3abca None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.133650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965040-9c74-48d2-ac42-13f0a1e3abca None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.134133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965040-9c74-48d2-ac42-13f0a1e3abca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.198644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a1965040-9c74-48d2-ac42-13f0a1e3abca None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:16.199464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199017b-94ec-4665-9803-0289fb9de51d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:16.207872 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a1965040-9c74-48d2-ac42-13f0a1e3abca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.248371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:16.310713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1127/2259] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:16.310713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45439-5fac-4e78-b17a-a023a477e927 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.310713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45439-5fac-4e78-b17a-a023a477e927 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.310713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45439-5fac-4e78-b17a-a023a477e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.318544 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4982-f123-48fc-bb6b-ce1727d8a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:16.319234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4982-f123-48fc-bb6b-ce1727d8a8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.319511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4982-f123-48fc-bb6b-ce1727d8a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.319780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4982-f123-48fc-bb6b-ce1727d8a8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.321317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e4982-f123-48fc-bb6b-ce1727d8a8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:16.324417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e4982-f123-48fc-bb6b-ce1727d8a8ed admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:16.339304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b9f45439-5fac-4e78-b17a-a023a477e927 None None] MFA Rules not processed for user `1781ce47229f4b138e5296f666260119`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:16.340622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1133/2260] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:16.340743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b9f45439-5fac-4e78-b17a-a023a477e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.342081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287214e-a5de-4253-afbb-853897c39d65 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.342355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287214e-a5de-4253-afbb-853897c39d65 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.342631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287214e-a5de-4253-afbb-853897c39d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.374858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1287214e-a5de-4253-afbb-853897c39d65 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:16.377375 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1287214e-a5de-4253-afbb-853897c39d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.392981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1134/2261] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:16.392981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287214e-a5de-4253-afbb-853897c39d65 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:16.392981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1287214e-a5de-4253-afbb-853897c39d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.408993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287214e-a5de-4253-afbb-853897c39d65 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:16.422446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d414f8-3093-475c-a22b-7e7fd4a83cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:16.423133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d414f8-3093-475c-a22b-7e7fd4a83cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.423415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d414f8-3093-475c-a22b-7e7fd4a83cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.423695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d414f8-3093-475c-a22b-7e7fd4a83cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.424464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d414f8-3093-475c-a22b-7e7fd4a83cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:16.426477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d414f8-3093-475c-a22b-7e7fd4a83cc4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:16.434531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1128/2262] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:16.437289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45439-5fac-4e78-b17a-a023a477e927 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:16.446992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1135/2263] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:16.448104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d414f8-3093-475c-a22b-7e7fd4a83cc4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:16.451638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e9d414f8-3093-475c-a22b-7e7fd4a83cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.451818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45439-5fac-4e78-b17a-a023a477e927 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:16.458925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edda76-bd65-4e3d-a57a-1b93e287d4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:16.459637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edda76-bd65-4e3d-a57a-1b93e287d4ca admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.460060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edda76-bd65-4e3d-a57a-1b93e287d4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.460358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edda76-bd65-4e3d-a57a-1b93e287d4ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.461270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edda76-bd65-4e3d-a57a-1b93e287d4ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:16.461598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edda76-bd65-4e3d-a57a-1b93e287d4ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:16.463457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edda76-bd65-4e3d-a57a-1b93e287d4ca admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:16.475405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d414f8-3093-475c-a22b-7e7fd4a83cc4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:16.475775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:16.481788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1129/2264] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:16.484122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:16.486370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edda76-bd65-4e3d-a57a-1b93e287d4ca admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:16.486849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.487856 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.488140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] PATH_INFO: `/v3/projects/4081da58fa074b928bc8e128dfaa2722` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.489832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4081da58fa074b928bc8e128dfaa2722)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:16.489964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d4edda76-bd65-4e3d-a57a-1b93e287d4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.492195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:16.559113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4081da58fa074b928bc8e128dfaa2722', 'request_id': 'req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.567074 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4081da58fa074b928bc8e128dfaa2722', 'request_id': 'req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.580254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4081da58fa074b928bc8e128dfaa2722', 'request_id': 'req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.591040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edda76-bd65-4e3d-a57a-1b93e287d4ca admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:16.598257 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] The token cache is being invalidate because project 4081da58fa074b928bc8e128dfaa2722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:16.598844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.599648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:16.601474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1136/2265] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:16 2022] DELETE /identity/v3/projects/4081da58fa074b928bc8e128dfaa2722 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:16.602240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:16.603694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.659518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d3f23-f945-4dfb-92c0-da5988235a26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b74d07fba34715a488539d630b0bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:16.660347 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d3f23-f945-4dfb-92c0-da5988235a26 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.660625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d3f23-f945-4dfb-92c0-da5988235a26 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.660899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d3f23-f945-4dfb-92c0-da5988235a26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.662807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ed6d3f23-f945-4dfb-92c0-da5988235a26 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.679487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae1e6a-9441-4384-b0e9-11b2b6279e8b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:16.705149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345632e3-1212-4228-aea9-c47e4fcc957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:16.706158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345632e3-1212-4228-aea9-c47e4fcc957e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.706425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345632e3-1212-4228-aea9-c47e4fcc957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.706717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345632e3-1212-4228-aea9-c47e4fcc957e admin admin] PATH_INFO: `/v3/projects/addde912245d4f29922db097142f0f23/users/ec2682cf98ea42fe989d795eac872dbd/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.724751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345632e3-1212-4228-aea9-c47e4fcc957e admin admin] RBAC: Authorizing `identity:create_grant(project_id=addde912245d4f29922db097142f0f23, user_id=ec2682cf98ea42fe989d795eac872dbd, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:16.728747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345632e3-1212-4228-aea9-c47e4fcc957e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:16.757450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1137/2266] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:16 2022] PUT /identity/v3/projects/addde912245d4f29922db097142f0f23/users/ec2682cf98ea42fe989d795eac872dbd/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:16.758900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345632e3-1212-4228-aea9-c47e4fcc957e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:16.763654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-345632e3-1212-4228-aea9-c47e4fcc957e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.775325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d3f23-f945-4dfb-92c0-da5988235a26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:16.776788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d3f23-f945-4dfb-92c0-da5988235a26 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:16.791324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1130/2267] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:16.792685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73696-9907-4b8a-ae30-b7b14e86ddeb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.792970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73696-9907-4b8a-ae30-b7b14e86ddeb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.798836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73696-9907-4b8a-ae30-b7b14e86ddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.800517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:16.835405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6eb73696-9907-4b8a-ae30-b7b14e86ddeb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:16.837032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6eb73696-9907-4b8a-ae30-b7b14e86ddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:16.880415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345632e3-1212-4228-aea9-c47e4fcc957e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:16.899938 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef8fb8-9612-4ece-b030-af8fc8c7814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:16.900619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef8fb8-9612-4ece-b030-af8fc8c7814f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.900897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef8fb8-9612-4ece-b030-af8fc8c7814f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.901238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef8fb8-9612-4ece-b030-af8fc8c7814f admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.902102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef8fb8-9612-4ece-b030-af8fc8c7814f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:16.905440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef8fb8-9612-4ece-b030-af8fc8c7814f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:16.962486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1138/2268] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:16 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:16.963934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c8945-547e-4175-be7d-90e509b6fa32 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:16.964221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c8945-547e-4175-be7d-90e509b6fa32 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:16.964497 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c8945-547e-4175-be7d-90e509b6fa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:16.973334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1131/2269] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:16.974281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb73696-9907-4b8a-ae30-b7b14e86ddeb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:16.990383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb73696-9907-4b8a-ae30-b7b14e86ddeb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:16.995946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:17.000995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5c3c8945-547e-4175-be7d-90e509b6fa32 None None] MFA Rules not processed for user `ec2682cf98ea42fe989d795eac872dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:17.003526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5c3c8945-547e-4175-be7d-90e509b6fa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:17.091673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1139/2270] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:17.092980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9dcd-3ead-47a6-9f0f-4a884eafc02c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.093362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9dcd-3ead-47a6-9f0f-4a884eafc02c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.094142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9dcd-3ead-47a6-9f0f-4a884eafc02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.103753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32ca95-6378-4160-9438-75449b1cd92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.104475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ca95-6378-4160-9438-75449b1cd92f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.104759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ca95-6378-4160-9438-75449b1cd92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.105040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ca95-6378-4160-9438-75449b1cd92f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.106198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32ca95-6378-4160-9438-75449b1cd92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.108252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32ca95-6378-4160-9438-75449b1cd92f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.120011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b7ed9dcd-3ead-47a6-9f0f-4a884eafc02c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:17.121235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b7ed9dcd-3ead-47a6-9f0f-4a884eafc02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:17.132465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1132/2271] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:16 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:17.134280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aae61-562b-4955-8a50-362970dab6d3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.134637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aae61-562b-4955-8a50-362970dab6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.135013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aae61-562b-4955-8a50-362970dab6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.138907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1140/2272] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:17.138907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed9dcd-3ead-47a6-9f0f-4a884eafc02c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.138907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b7ed9dcd-3ead-47a6-9f0f-4a884eafc02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:17.156157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ce2aae61-562b-4955-8a50-362970dab6d3 None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:17.157510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ce2aae61-562b-4955-8a50-362970dab6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:17.231808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1133/2273] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:17.233306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aae61-562b-4955-8a50-362970dab6d3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.247788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aae61-562b-4955-8a50-362970dab6d3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.254557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53aa277-d777-40f1-8487-021ba0c6a0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.257503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aa277-d777-40f1-8487-021ba0c6a0db admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.258155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aa277-d777-40f1-8487-021ba0c6a0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.258445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aa277-d777-40f1-8487-021ba0c6a0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.259483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53aa277-d777-40f1-8487-021ba0c6a0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.261473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53aa277-d777-40f1-8487-021ba0c6a0db admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.276822 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed9dcd-3ead-47a6-9f0f-4a884eafc02c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.280379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1134/2274] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:17.280379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53aa277-d777-40f1-8487-021ba0c6a0db admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.292437 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04ff95-aed4-471f-9b43-0e2e7aeb1382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.292693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53aa277-d777-40f1-8487-021ba0c6a0db admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.294700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04ff95-aed4-471f-9b43-0e2e7aeb1382 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.294990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04ff95-aed4-471f-9b43-0e2e7aeb1382 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.295271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04ff95-aed4-471f-9b43-0e2e7aeb1382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.298244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae432c1-d54b-4421-b213-0d6334bb1418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.299016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae432c1-d54b-4421-b213-0d6334bb1418 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.299336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae432c1-d54b-4421-b213-0d6334bb1418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.299782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae432c1-d54b-4421-b213-0d6334bb1418 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.300771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae432c1-d54b-4421-b213-0d6334bb1418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:17.301531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae432c1-d54b-4421-b213-0d6334bb1418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.303180 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae432c1-d54b-4421-b213-0d6334bb1418 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.312266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04ff95-aed4-471f-9b43-0e2e7aeb1382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.314120 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04ff95-aed4-471f-9b43-0e2e7aeb1382 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.326315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1141/2275] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:17 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:17.327280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04ff95-aed4-471f-9b43-0e2e7aeb1382 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.334868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1135/2276] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:17.335804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae432c1-d54b-4421-b213-0d6334bb1418 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.338196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6ae432c1-d54b-4421-b213-0d6334bb1418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:17.341763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04ff95-aed4-471f-9b43-0e2e7aeb1382 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.348669 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33959b-dd30-47a9-902e-6032ea71c067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.349493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33959b-dd30-47a9-902e-6032ea71c067 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.349842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33959b-dd30-47a9-902e-6032ea71c067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.350393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33959b-dd30-47a9-902e-6032ea71c067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.351315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33959b-dd30-47a9-902e-6032ea71c067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.353060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33959b-dd30-47a9-902e-6032ea71c067 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.380843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1142/2277] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:17.383564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33959b-dd30-47a9-902e-6032ea71c067 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.402667 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33959b-dd30-47a9-902e-6032ea71c067 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.410467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e7883-2f7f-4c0f-89d3-25da65c65c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.412224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e7883-2f7f-4c0f-89d3-25da65c65c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.412696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e7883-2f7f-4c0f-89d3-25da65c65c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.413836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e7883-2f7f-4c0f-89d3-25da65c65c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.414683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e7883-2f7f-4c0f-89d3-25da65c65c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.417515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e7883-2f7f-4c0f-89d3-25da65c65c80 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.435582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:17.461990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1143/2278] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:17 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:17.462928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e7883-2f7f-4c0f-89d3-25da65c65c80 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.481478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae432c1-d54b-4421-b213-0d6334bb1418 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.549260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:17.584468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e7883-2f7f-4c0f-89d3-25da65c65c80 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.593286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22f854-4202-43c7-ba91-0ca259706154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.594320 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22f854-4202-43c7-ba91-0ca259706154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.594667 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22f854-4202-43c7-ba91-0ca259706154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.595037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22f854-4202-43c7-ba91-0ca259706154 admin admin] PATH_INFO: `/v3/projects/b856c7149dec4b51bc20f4a41d42c892/users/044b5c711fb844cd9810a64333dc7d47/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.631312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22f854-4202-43c7-ba91-0ca259706154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b856c7149dec4b51bc20f4a41d42c892, user_id=044b5c711fb844cd9810a64333dc7d47, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.635624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22f854-4202-43c7-ba91-0ca259706154 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.645107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76982386-2edc-402a-a410-73cd39d216a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.645885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76982386-2edc-402a-a410-73cd39d216a5 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.646163 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76982386-2edc-402a-a410-73cd39d216a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.646584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76982386-2edc-402a-a410-73cd39d216a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.659338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1144/2279] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:17 2022] PUT /identity/v3/projects/b856c7149dec4b51bc20f4a41d42c892/users/044b5c711fb844cd9810a64333dc7d47/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:17.660601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22f854-4202-43c7-ba91-0ca259706154 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.741635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76982386-2edc-402a-a410-73cd39d216a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.744698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76982386-2edc-402a-a410-73cd39d216a5 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.755628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1136/2280] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:14:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:14:17.763254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfcf34-1957-499e-8052-740873daf38b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.763550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfcf34-1957-499e-8052-740873daf38b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.763828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfcf34-1957-499e-8052-740873daf38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.774262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22f854-4202-43c7-ba91-0ca259706154 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.791185 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103df62-9195-410e-b0c5-ef0ffa004135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.791962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103df62-9195-410e-b0c5-ef0ffa004135 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.792246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103df62-9195-410e-b0c5-ef0ffa004135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.792529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103df62-9195-410e-b0c5-ef0ffa004135 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.793304 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103df62-9195-410e-b0c5-ef0ffa004135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.795477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103df62-9195-410e-b0c5-ef0ffa004135 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.828569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-17dfcf34-1957-499e-8052-740873daf38b None None] MFA Rules not processed for user `044b5c711fb844cd9810a64333dc7d47`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:17.832366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-17dfcf34-1957-499e-8052-740873daf38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:17.848001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1145/2281] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:17 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:17.853238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103df62-9195-410e-b0c5-ef0ffa004135 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.869656 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103df62-9195-410e-b0c5-ef0ffa004135 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.872820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553317-7558-40ca-93e6-35b2cfb30a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.873592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553317-7558-40ca-93e6-35b2cfb30a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.873877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553317-7558-40ca-93e6-35b2cfb30a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.874156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553317-7558-40ca-93e6-35b2cfb30a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.874889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec553317-7558-40ca-93e6-35b2cfb30a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.876825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec553317-7558-40ca-93e6-35b2cfb30a79 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.892435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1146/2282] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:17.898442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553317-7558-40ca-93e6-35b2cfb30a79 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.918698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553317-7558-40ca-93e6-35b2cfb30a79 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.928312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4d23-1c0d-4d32-997c-123b1ab507cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.929045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4d23-1c0d-4d32-997c-123b1ab507cb admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.929366 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4d23-1c0d-4d32-997c-123b1ab507cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.929715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4d23-1c0d-4d32-997c-123b1ab507cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.930427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd4d23-1c0d-4d32-997c-123b1ab507cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:17.932175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd4d23-1c0d-4d32-997c-123b1ab507cb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:17.945041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1147/2283] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:17.953298 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4d23-1c0d-4d32-997c-123b1ab507cb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.955699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1137/2284] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:17.966409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4d23-1c0d-4d32-997c-123b1ab507cb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:17.971669 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfcf34-1957-499e-8052-740873daf38b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:17.971783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eb8cc-9e65-4fb0-9e44-f2e08a6d66e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:17.972802 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eb8cc-9e65-4fb0-9e44-f2e08a6d66e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:17.973083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eb8cc-9e65-4fb0-9e44-f2e08a6d66e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:17.973399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eb8cc-9e65-4fb0-9e44-f2e08a6d66e7 admin admin] PATH_INFO: `/v3/projects/2eef0d41c9c645ca94a00cfdcccda4f1/users/bffa24b29ac8456689a7efb9dae6eff8/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:17.973508 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-17dfcf34-1957-499e-8052-740873daf38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:18.004558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eb8cc-9e65-4fb0-9e44-f2e08a6d66e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eef0d41c9c645ca94a00cfdcccda4f1, user_id=bffa24b29ac8456689a7efb9dae6eff8, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:18.007607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eb8cc-9e65-4fb0-9e44-f2e08a6d66e7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:18.033765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1148/2285] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:17 2022] PUT /identity/v3/projects/2eef0d41c9c645ca94a00cfdcccda4f1/users/bffa24b29ac8456689a7efb9dae6eff8/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:18.044599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793269d1-4dc5-4e25-8503-30c1f6a665af None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:18.044879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793269d1-4dc5-4e25-8503-30c1f6a665af None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:18.045386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793269d1-4dc5-4e25-8503-30c1f6a665af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:18.062052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfcf34-1957-499e-8052-740873daf38b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:18.072927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:18.094243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-793269d1-4dc5-4e25-8503-30c1f6a665af None None] MFA Rules not processed for user `bffa24b29ac8456689a7efb9dae6eff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:18.095789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-793269d1-4dc5-4e25-8503-30c1f6a665af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:18.108639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:18.165774 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e8ff3-e4e6-435b-8d62-bcd79940866a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b74d07fba34715a488539d630b0bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:18.166970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e8ff3-e4e6-435b-8d62-bcd79940866a service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:18.167264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e8ff3-e4e6-435b-8d62-bcd79940866a service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:18.167547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e8ff3-e4e6-435b-8d62-bcd79940866a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:18.207411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1149/2286] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:14:18.213983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793269d1-4dc5-4e25-8503-30c1f6a665af None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:18.273974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e8ff3-e4e6-435b-8d62-bcd79940866a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:18.276383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e8ff3-e4e6-435b-8d62-bcd79940866a service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:18.288284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1138/2287] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:14:18.343564 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793269d1-4dc5-4e25-8503-30c1f6a665af None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:18.348710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f917f-71ca-4641-a5aa-09f19dc408e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:18.349569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f917f-71ca-4641-a5aa-09f19dc408e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:18.350072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f917f-71ca-4641-a5aa-09f19dc408e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:18.350359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f917f-71ca-4641-a5aa-09f19dc408e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:18.351057 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f917f-71ca-4641-a5aa-09f19dc408e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:18.352980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f917f-71ca-4641-a5aa-09f19dc408e3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:18.398393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1150/2288] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:18 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:18.402212 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e8ff3-e4e6-435b-8d62-bcd79940866a service glance] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:18.427853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e8ff3-e4e6-435b-8d62-bcd79940866a service glance] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:18.595237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640d8f0-720c-4d0c-a7e0-ea3e3ca260fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:18.596711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640d8f0-720c-4d0c-a7e0-ea3e3ca260fb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:18.596849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640d8f0-720c-4d0c-a7e0-ea3e3ca260fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:18.597190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640d8f0-720c-4d0c-a7e0-ea3e3ca260fb admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:18.608230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640d8f0-720c-4d0c-a7e0-ea3e3ca260fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:18.609487 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640d8f0-720c-4d0c-a7e0-ea3e3ca260fb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:18.656628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1139/2289] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:18 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:18.660809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f917f-71ca-4641-a5aa-09f19dc408e3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:18.675839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f917f-71ca-4641-a5aa-09f19dc408e3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:18.682678 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8989f3-66a1-46cf-a240-a92a68355d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:18.684103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8989f3-66a1-46cf-a240-a92a68355d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:18.684700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8989f3-66a1-46cf-a240-a92a68355d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:18.685621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8989f3-66a1-46cf-a240-a92a68355d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:18.688605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8989f3-66a1-46cf-a240-a92a68355d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:18.690875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8989f3-66a1-46cf-a240-a92a68355d2f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:18.725349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1151/2290] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:18.725932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640d8f0-720c-4d0c-a7e0-ea3e3ca260fb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:18.740845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640d8f0-720c-4d0c-a7e0-ea3e3ca260fb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:18.748019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e0ad0-6127-4bf0-bbee-a1b86fa28944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:18.748933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e0ad0-6127-4bf0-bbee-a1b86fa28944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:18.749230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e0ad0-6127-4bf0-bbee-a1b86fa28944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:18.749510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e0ad0-6127-4bf0-bbee-a1b86fa28944 admin admin] PATH_INFO: `/v3/projects/7f7931e072e34719b9c1bbf4fcf09991/users/6b9ddff43fa84bd0b673ac8a8e9a2308/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:18.770162 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e0ad0-6127-4bf0-bbee-a1b86fa28944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7931e072e34719b9c1bbf4fcf09991, user_id=6b9ddff43fa84bd0b673ac8a8e9a2308, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:18.774297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e0ad0-6127-4bf0-bbee-a1b86fa28944 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:18.806015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1140/2291] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:18 2022] PUT /identity/v3/projects/7f7931e072e34719b9c1bbf4fcf09991/users/6b9ddff43fa84bd0b673ac8a8e9a2308/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:18.811676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8989f3-66a1-46cf-a240-a92a68355d2f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:18.844913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8989f3-66a1-46cf-a240-a92a68355d2f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:19.012580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889395c1-21b8-4137-8603-43b36d44886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:19.013903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889395c1-21b8-4137-8603-43b36d44886e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:19.013903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889395c1-21b8-4137-8603-43b36d44886e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:19.014103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889395c1-21b8-4137-8603-43b36d44886e admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:19.014889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889395c1-21b8-4137-8603-43b36d44886e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:19.017745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889395c1-21b8-4137-8603-43b36d44886e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:19.051559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1152/2292] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:19.052772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e0ad0-6127-4bf0-bbee-a1b86fa28944 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:19.069392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e0ad0-6127-4bf0-bbee-a1b86fa28944 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:19.089255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09695a5-92e1-4762-b26f-c76474f7d0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:19.090277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09695a5-92e1-4762-b26f-c76474f7d0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:19.090562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09695a5-92e1-4762-b26f-c76474f7d0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:19.090839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09695a5-92e1-4762-b26f-c76474f7d0b5 admin admin] PATH_INFO: `/v3/projects/7f7931e072e34719b9c1bbf4fcf09991/users/6b9ddff43fa84bd0b673ac8a8e9a2308/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:19.114210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09695a5-92e1-4762-b26f-c76474f7d0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7931e072e34719b9c1bbf4fcf09991, user_id=6b9ddff43fa84bd0b673ac8a8e9a2308, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:19.120542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09695a5-92e1-4762-b26f-c76474f7d0b5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:19.147943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1141/2293] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:19 2022] PUT /identity/v3/projects/7f7931e072e34719b9c1bbf4fcf09991/users/6b9ddff43fa84bd0b673ac8a8e9a2308/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:19.164444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969d25-ff92-443e-b65f-bbd34c265f5e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:19.165400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969d25-ff92-443e-b65f-bbd34c265f5e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:19.165850 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969d25-ff92-443e-b65f-bbd34c265f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:19.249642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bf969d25-ff92-443e-b65f-bbd34c265f5e None None] MFA Rules not processed for user `6b9ddff43fa84bd0b673ac8a8e9a2308`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:19.253445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bf969d25-ff92-443e-b65f-bbd34c265f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:19.281540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:19.423326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1153/2294] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:19.510706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09695a5-92e1-4762-b26f-c76474f7d0b5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:19.513472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c09695a5-92e1-4762-b26f-c76474f7d0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:19.569997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:19.675123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09695a5-92e1-4762-b26f-c76474f7d0b5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:19.690841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca81851-9544-4fcf-9fd1-0f1cc45aca66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:19.692135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca81851-9544-4fcf-9fd1-0f1cc45aca66 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:19.692480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca81851-9544-4fcf-9fd1-0f1cc45aca66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:19.692969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca81851-9544-4fcf-9fd1-0f1cc45aca66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:19.705362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca81851-9544-4fcf-9fd1-0f1cc45aca66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:19.707139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca81851-9544-4fcf-9fd1-0f1cc45aca66 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:19.736658 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1142/2295] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:20.458232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf969d25-ff92-443e-b65f-bbd34c265f5e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:20.470507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf969d25-ff92-443e-b65f-bbd34c265f5e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:20.474725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e2cc7-19c2-457a-aac3-0e79c3889fbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:20.475510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e2cc7-19c2-457a-aac3-0e79c3889fbe service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:20.476126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e2cc7-19c2-457a-aac3-0e79c3889fbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:20.476126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e2cc7-19c2-457a-aac3-0e79c3889fbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:20.564339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e2cc7-19c2-457a-aac3-0e79c3889fbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:20.567496 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e2cc7-19c2-457a-aac3-0e79c3889fbe service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:20.584138 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1154/2296] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:23.760369 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca81851-9544-4fcf-9fd1-0f1cc45aca66 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:23.914525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca81851-9544-4fcf-9fd1-0f1cc45aca66 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:23.922043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:23.922858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:23.923134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:23.923406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] PATH_INFO: `/v3/users/bffa24b29ac8456689a7efb9dae6eff8` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:23.926846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bffa24b29ac8456689a7efb9dae6eff8)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:23.928921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:23.988083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bffa24b29ac8456689a7efb9dae6eff8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:23.996094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bffa24b29ac8456689a7efb9dae6eff8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:23.996841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bffa24b29ac8456689a7efb9dae6eff8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.011228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bffa24b29ac8456689a7efb9dae6eff8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.026611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5f5fa028-7f24-4539-845e-660e16b2190e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bffa24b29ac8456689a7efb9dae6eff8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.039934 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1143/2297] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:23 2022] DELETE /identity/v3/users/bffa24b29ac8456689a7efb9dae6eff8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:24.044371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083aa7e-49bd-4ab0-a8bc-fcc9c26beade None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:24.045813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083aa7e-49bd-4ab0-a8bc-fcc9c26beade None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:24.046316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083aa7e-49bd-4ab0-a8bc-fcc9c26beade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:24.076882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b083aa7e-49bd-4ab0-a8bc-fcc9c26beade None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:24.081997 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b083aa7e-49bd-4ab0-a8bc-fcc9c26beade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:24.141446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73550a66-9a2f-474e-a8b0-c1b5b318f59c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:24.141446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73550a66-9a2f-474e-a8b0-c1b5b318f59c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:24.141446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73550a66-9a2f-474e-a8b0-c1b5b318f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:24.173908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-73550a66-9a2f-474e-a8b0-c1b5b318f59c None None] MFA Rules not processed for user `d770c98d01ea4c9bb20b79dab4bfc0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:24.175179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-73550a66-9a2f-474e-a8b0-c1b5b318f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:24.188255 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1155/2298] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:24.200363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083aa7e-49bd-4ab0-a8bc-fcc9c26beade None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:24.202083 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b083aa7e-49bd-4ab0-a8bc-fcc9c26beade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:24.215679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:24.249329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1144/2299] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:24.269284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:24.277445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083aa7e-49bd-4ab0-a8bc-fcc9c26beade None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:24.281847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c4a12-196f-4ded-b2ea-3a4933196358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:24.282506 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4a12-196f-4ded-b2ea-3a4933196358 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:24.282790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4a12-196f-4ded-b2ea-3a4933196358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:24.283068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4a12-196f-4ded-b2ea-3a4933196358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:24.293087 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c4a12-196f-4ded-b2ea-3a4933196358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:24.294945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c4a12-196f-4ded-b2ea-3a4933196358 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:24.308128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1156/2300] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:24.640833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73550a66-9a2f-474e-a8b0-c1b5b318f59c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:24.642011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-73550a66-9a2f-474e-a8b0-c1b5b318f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:24.669009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73550a66-9a2f-474e-a8b0-c1b5b318f59c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:24.676204 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:24.677610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:24.678048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:24.678464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] PATH_INFO: `/v3/projects/2eef0d41c9c645ca94a00cfdcccda4f1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:24.679854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eef0d41c9c645ca94a00cfdcccda4f1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:24.683215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:24.744365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eef0d41c9c645ca94a00cfdcccda4f1', 'request_id': 'req-3c934b25-4257-4101-a2c1-28cba4fb7d1e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.754114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eef0d41c9c645ca94a00cfdcccda4f1', 'request_id': 'req-3c934b25-4257-4101-a2c1-28cba4fb7d1e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.764398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eef0d41c9c645ca94a00cfdcccda4f1', 'request_id': 'req-3c934b25-4257-4101-a2c1-28cba4fb7d1e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.779486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] The token cache is being invalidate because project 2eef0d41c9c645ca94a00cfdcccda4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:24.779768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.780421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.782224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1145/2301] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:24 2022] DELETE /identity/v3/projects/2eef0d41c9c645ca94a00cfdcccda4f1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:24.794691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c4a12-196f-4ded-b2ea-3a4933196358 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:24.806879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c4a12-196f-4ded-b2ea-3a4933196358 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:24.905538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:24.906519 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:24.906892 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:24.907267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] PATH_INFO: `/v3/users/6b9ddff43fa84bd0b673ac8a8e9a2308` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:24.908790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9ddff43fa84bd0b673ac8a8e9a2308)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:24.911052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:24.971500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9ddff43fa84bd0b673ac8a8e9a2308'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.981375 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9ddff43fa84bd0b673ac8a8e9a2308'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.982770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9ddff43fa84bd0b673ac8a8e9a2308'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.991109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9ddff43fa84bd0b673ac8a8e9a2308'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:24.992075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a435c17-87d8-4cc9-bc49-1ed6ee9f1942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9ddff43fa84bd0b673ac8a8e9a2308'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:25.012286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1157/2302] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:24 2022] DELETE /identity/v3/users/6b9ddff43fa84bd0b673ac8a8e9a2308 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:25.422399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:25.423943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:25.439298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c934b25-4257-4101-a2c1-28cba4fb7d1e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:25.536353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:25.537576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:25.538125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:25.538504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] PATH_INFO: `/v3/projects/7f7931e072e34719b9c1bbf4fcf09991` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:25.539983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7931e072e34719b9c1bbf4fcf09991)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:25.543832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:25.605550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7931e072e34719b9c1bbf4fcf09991', 'request_id': 'req-feafe043-4db4-4353-a80c-23ed9fdcb719'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:25.612442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7931e072e34719b9c1bbf4fcf09991', 'request_id': 'req-feafe043-4db4-4353-a80c-23ed9fdcb719'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:25.623137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7931e072e34719b9c1bbf4fcf09991', 'request_id': 'req-feafe043-4db4-4353-a80c-23ed9fdcb719'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:25.630303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:25.646175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] The token cache is being invalidate because project 7f7931e072e34719b9c1bbf4fcf09991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:25.646376 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:25.647184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-feafe043-4db4-4353-a80c-23ed9fdcb719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:25.649237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1146/2303] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:25 2022] DELETE /identity/v3/projects/7f7931e072e34719b9c1bbf4fcf09991 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:25.654228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0ed0-474e-43fc-a462-296f70d559f0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:25.654820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0ed0-474e-43fc-a462-296f70d559f0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:25.655457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0ed0-474e-43fc-a462-296f70d559f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:25.684835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-311f0ed0-474e-43fc-a462-296f70d559f0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:25.687332 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-311f0ed0-474e-43fc-a462-296f70d559f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:25.776166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1158/2304] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:25.789786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b870e9-5ad0-4b92-b1a1-1689917fcec5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:25.789786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b870e9-5ad0-4b92-b1a1-1689917fcec5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:25.789786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b870e9-5ad0-4b92-b1a1-1689917fcec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:25.809160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b1b870e9-5ad0-4b92-b1a1-1689917fcec5 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:25.810630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b1b870e9-5ad0-4b92-b1a1-1689917fcec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:25.819392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1147/2305] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:25.823884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0ed0-474e-43fc-a462-296f70d559f0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:25.835835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0ed0-474e-43fc-a462-296f70d559f0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:25.842299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5cc9-6fd8-4dab-ab25-be9db2d4e6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:25.843025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5cc9-6fd8-4dab-ab25-be9db2d4e6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:25.843354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5cc9-6fd8-4dab-ab25-be9db2d4e6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:25.843711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5cc9-6fd8-4dab-ab25-be9db2d4e6a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:25.844510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5cc9-6fd8-4dab-ab25-be9db2d4e6a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:25.844818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5cc9-6fd8-4dab-ab25-be9db2d4e6a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:25.846816 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5cc9-6fd8-4dab-ab25-be9db2d4e6a7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:25.852674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:25.867157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1159/2306] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:25.871048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b870e9-5ad0-4b92-b1a1-1689917fcec5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:25.881260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b870e9-5ad0-4b92-b1a1-1689917fcec5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:25.886037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653479c3-fa53-472e-afe5-207ae73b54a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:25.886778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653479c3-fa53-472e-afe5-207ae73b54a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:25.887152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653479c3-fa53-472e-afe5-207ae73b54a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:25.887512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653479c3-fa53-472e-afe5-207ae73b54a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:25.888581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653479c3-fa53-472e-afe5-207ae73b54a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:25.890998 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653479c3-fa53-472e-afe5-207ae73b54a4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:25.925910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1148/2307] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:25 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:14:25.929899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5cc9-6fd8-4dab-ab25-be9db2d4e6a7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:25.943929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5cc9-6fd8-4dab-ab25-be9db2d4e6a7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:26.013717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e93f07-bd61-4255-b936-013c60c3e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:26.014557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e93f07-bd61-4255-b936-013c60c3e030 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:26.014908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e93f07-bd61-4255-b936-013c60c3e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:26.015253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e93f07-bd61-4255-b936-013c60c3e030 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:26.016569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e93f07-bd61-4255-b936-013c60c3e030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:26.018746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e93f07-bd61-4255-b936-013c60c3e030 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:26.101251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653479c3-fa53-472e-afe5-207ae73b54a4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:26.101600 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1160/2308] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:25 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:26.122230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653479c3-fa53-472e-afe5-207ae73b54a4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:26.127976 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17da27b-3fb7-4bcc-ae09-41ddf03ad9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:26.129465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da27b-3fb7-4bcc-ae09-41ddf03ad9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:26.130000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da27b-3fb7-4bcc-ae09-41ddf03ad9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:26.130484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da27b-3fb7-4bcc-ae09-41ddf03ad9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:26.131499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17da27b-3fb7-4bcc-ae09-41ddf03ad9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:26.133573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17da27b-3fb7-4bcc-ae09-41ddf03ad9e9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:26.168331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1149/2309] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:26.170630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e93f07-bd61-4255-b936-013c60c3e030 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:26.196717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e93f07-bd61-4255-b936-013c60c3e030 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:26.214701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e782ee8-df0f-4e82-a8ac-b11345e93597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:26.215539 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782ee8-df0f-4e82-a8ac-b11345e93597 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:26.215818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782ee8-df0f-4e82-a8ac-b11345e93597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:26.217257 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782ee8-df0f-4e82-a8ac-b11345e93597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:26.217985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e782ee8-df0f-4e82-a8ac-b11345e93597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:26.229291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e782ee8-df0f-4e82-a8ac-b11345e93597 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:26.248860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1161/2310] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:26.254257 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17da27b-3fb7-4bcc-ae09-41ddf03ad9e9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:26.271996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17da27b-3fb7-4bcc-ae09-41ddf03ad9e9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:26.280140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bb6cd-2933-49f7-9005-ba6b3e95336a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:26.281043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bb6cd-2933-49f7-9005-ba6b3e95336a admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:26.281361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bb6cd-2933-49f7-9005-ba6b3e95336a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:26.281635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bb6cd-2933-49f7-9005-ba6b3e95336a admin admin] PATH_INFO: `/v3/projects/31d8c7eb1101442ab7506b0762d3a195/users/8e384887cb634a109e85f665faaf14e1/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:26.301865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bb6cd-2933-49f7-9005-ba6b3e95336a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d8c7eb1101442ab7506b0762d3a195, user_id=8e384887cb634a109e85f665faaf14e1, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:26.305072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bb6cd-2933-49f7-9005-ba6b3e95336a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:26.334233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1150/2311] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:26 2022] PUT /identity/v3/projects/31d8c7eb1101442ab7506b0762d3a195/users/8e384887cb634a109e85f665faaf14e1/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:26.340347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d02b-d7f1-434a-b63e-7f490ed87bc1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:26.340773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d02b-d7f1-434a-b63e-7f490ed87bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:26.341147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d02b-d7f1-434a-b63e-7f490ed87bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:26.372715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-efd5d02b-d7f1-434a-b63e-7f490ed87bc1 None None] MFA Rules not processed for user `8e384887cb634a109e85f665faaf14e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:26.374150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-efd5d02b-d7f1-434a-b63e-7f490ed87bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:26.454628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1162/2312] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:26.466961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bb6cd-2933-49f7-9005-ba6b3e95336a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:26.469034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-909bb6cd-2933-49f7-9005-ba6b3e95336a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:26.577853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bb6cd-2933-49f7-9005-ba6b3e95336a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:26.583347 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938f566-3ae6-41cc-a822-3e88ec49b730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:26.584200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f566-3ae6-41cc-a822-3e88ec49b730 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:26.584428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f566-3ae6-41cc-a822-3e88ec49b730 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:26.584711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f566-3ae6-41cc-a822-3e88ec49b730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:26.596505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938f566-3ae6-41cc-a822-3e88ec49b730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:26.598459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938f566-3ae6-41cc-a822-3e88ec49b730 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:26.609012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1151/2313] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:26.632715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d02b-d7f1-434a-b63e-7f490ed87bc1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:26.723162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d02b-d7f1-434a-b63e-7f490ed87bc1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:26.729442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:26.731003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:26.731003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:26.731003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] PATH_INFO: `/v3/users/8e384887cb634a109e85f665faaf14e1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:26.732194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e384887cb634a109e85f665faaf14e1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:26.734205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:26.740673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:26.844981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e384887cb634a109e85f665faaf14e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:26.865674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e384887cb634a109e85f665faaf14e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:26.866851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e384887cb634a109e85f665faaf14e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:26.879813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e384887cb634a109e85f665faaf14e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:26.880849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e384887cb634a109e85f665faaf14e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:26.907977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1163/2314] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:26 2022] DELETE /identity/v3/users/8e384887cb634a109e85f665faaf14e1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:26.914374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd99ed-c99a-4b85-88fe-80ba3d0a429b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:26.915285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd99ed-c99a-4b85-88fe-80ba3d0a429b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:26.915576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd99ed-c99a-4b85-88fe-80ba3d0a429b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:26.937042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7dcd99ed-c99a-4b85-88fe-80ba3d0a429b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:26.938423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7dcd99ed-c99a-4b85-88fe-80ba3d0a429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:27.015607 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1152/2315] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:27.026391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:27.027931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:27.137869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e368470-a7a6-4712-beff-ce5573f39642 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:27.142206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fff7b1-702a-4d53-8808-29e29d55dad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:27.143159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fff7b1-702a-4d53-8808-29e29d55dad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:27.143549 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fff7b1-702a-4d53-8808-29e29d55dad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:27.143937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fff7b1-702a-4d53-8808-29e29d55dad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:27.157558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fff7b1-702a-4d53-8808-29e29d55dad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:27.159440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fff7b1-702a-4d53-8808-29e29d55dad9 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:27.174758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1164/2316] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:27.497663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd99ed-c99a-4b85-88fe-80ba3d0a429b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:27.499842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7dcd99ed-c99a-4b85-88fe-80ba3d0a429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:27.539728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd99ed-c99a-4b85-88fe-80ba3d0a429b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:27.564919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:27.570076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:27.570365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:27.570648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] PATH_INFO: `/v3/projects/31d8c7eb1101442ab7506b0762d3a195` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:27.572158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d8c7eb1101442ab7506b0762d3a195)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:27.574326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:27.617843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:27.636773 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d8c7eb1101442ab7506b0762d3a195', 'request_id': 'req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:27.644063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d8c7eb1101442ab7506b0762d3a195', 'request_id': 'req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:27.653699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d8c7eb1101442ab7506b0762d3a195', 'request_id': 'req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:27.675573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] The token cache is being invalidate because project 31d8c7eb1101442ab7506b0762d3a195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:27.676673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:27.678137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-79a5381a-d135-40ee-98b0-d5ed99f5dd2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:27.682115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1153/2317] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:27 2022] DELETE /identity/v3/projects/31d8c7eb1101442ab7506b0762d3a195 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:27.688733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc131e6-e0a9-4070-a1eb-8a49882cf363 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:27.689880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc131e6-e0a9-4070-a1eb-8a49882cf363 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:27.690857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc131e6-e0a9-4070-a1eb-8a49882cf363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:27.713045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dcc131e6-e0a9-4070-a1eb-8a49882cf363 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:27.714455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dcc131e6-e0a9-4070-a1eb-8a49882cf363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:27.778311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1165/2318] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:14:27.789748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60c106-0450-4dd9-b47f-f3de68a5dcc0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:27.790071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60c106-0450-4dd9-b47f-f3de68a5dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:27.790309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60c106-0450-4dd9-b47f-f3de68a5dcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:27.815609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cd60c106-0450-4dd9-b47f-f3de68a5dcc0 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:27.817142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cd60c106-0450-4dd9-b47f-f3de68a5dcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:27.826986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1154/2319] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:27.831642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc131e6-e0a9-4070-a1eb-8a49882cf363 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:27.844429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc131e6-e0a9-4070-a1eb-8a49882cf363 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:27.851145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b02a8b-10d3-4b87-9c2d-c4d572046311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:27.851831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02a8b-10d3-4b87-9c2d-c4d572046311 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:27.852117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02a8b-10d3-4b87-9c2d-c4d572046311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:27.852394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02a8b-10d3-4b87-9c2d-c4d572046311 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:27.853144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b02a8b-10d3-4b87-9c2d-c4d572046311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:27.853499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b02a8b-10d3-4b87-9c2d-c4d572046311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:27.855153 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b02a8b-10d3-4b87-9c2d-c4d572046311 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:27.874101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1166/2320] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:27.875728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60c106-0450-4dd9-b47f-f3de68a5dcc0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:27.888399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60c106-0450-4dd9-b47f-f3de68a5dcc0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:27.893643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1190780-c211-4a07-ad49-136a4979667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:27.894375 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1190780-c211-4a07-ad49-136a4979667a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:27.894652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1190780-c211-4a07-ad49-136a4979667a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:27.895073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1190780-c211-4a07-ad49-136a4979667a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:27.895769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1190780-c211-4a07-ad49-136a4979667a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:27.899755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1190780-c211-4a07-ad49-136a4979667a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:27.947598 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1155/2321] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:27 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:27.953704 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b02a8b-10d3-4b87-9c2d-c4d572046311 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:27.967376 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b02a8b-10d3-4b87-9c2d-c4d572046311 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:27.980444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:28.041017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ee0c0-a661-4d1b-ac05-8a4bdb51ac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:28.041865 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ee0c0-a661-4d1b-ac05-8a4bdb51ac97 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:28.042213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ee0c0-a661-4d1b-ac05-8a4bdb51ac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:28.042568 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ee0c0-a661-4d1b-ac05-8a4bdb51ac97 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:28.043354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ee0c0-a661-4d1b-ac05-8a4bdb51ac97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:28.046095 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ee0c0-a661-4d1b-ac05-8a4bdb51ac97 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:28.072098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1167/2322] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:27 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:28.076281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1190780-c211-4a07-ad49-136a4979667a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:28.088977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1190780-c211-4a07-ad49-136a4979667a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:28.094375 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9162f1b-41af-4dbf-b538-3052ac31ff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:28.095120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9162f1b-41af-4dbf-b538-3052ac31ff73 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:28.095465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9162f1b-41af-4dbf-b538-3052ac31ff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:28.095808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9162f1b-41af-4dbf-b538-3052ac31ff73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:28.097039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9162f1b-41af-4dbf-b538-3052ac31ff73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:28.099290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9162f1b-41af-4dbf-b538-3052ac31ff73 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:28.111651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1156/2323] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:28.116218 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ee0c0-a661-4d1b-ac05-8a4bdb51ac97 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:28.127197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ee0c0-a661-4d1b-ac05-8a4bdb51ac97 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:28.133921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edd3a4-e46b-4835-b444-ba99c8012838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:28.134929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edd3a4-e46b-4835-b444-ba99c8012838 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:28.135210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edd3a4-e46b-4835-b444-ba99c8012838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:28.135485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edd3a4-e46b-4835-b444-ba99c8012838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:28.136258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edd3a4-e46b-4835-b444-ba99c8012838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:28.137940 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edd3a4-e46b-4835-b444-ba99c8012838 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:28.152426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1168/2324] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:28.157023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9162f1b-41af-4dbf-b538-3052ac31ff73 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:28.174695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9162f1b-41af-4dbf-b538-3052ac31ff73 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:28.184266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de2cfe-73d3-4652-86ce-6bcc78e84fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:28.185428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2cfe-73d3-4652-86ce-6bcc78e84fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:28.185733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2cfe-73d3-4652-86ce-6bcc78e84fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:28.186017 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2cfe-73d3-4652-86ce-6bcc78e84fcd admin admin] PATH_INFO: `/v3/projects/163ae885b74946a393a4dd1121a0c98c/users/a1a6ceb13aa643c8be8a2b58cd571cf1/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:28.235623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de2cfe-73d3-4652-86ce-6bcc78e84fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=163ae885b74946a393a4dd1121a0c98c, user_id=a1a6ceb13aa643c8be8a2b58cd571cf1, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:28.238436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de2cfe-73d3-4652-86ce-6bcc78e84fcd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:28.264384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1157/2325] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:28 2022] PUT /identity/v3/projects/163ae885b74946a393a4dd1121a0c98c/users/a1a6ceb13aa643c8be8a2b58cd571cf1/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:28.266382 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3aa6ff-d33c-4d3c-8f09-ca8a4928abeb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:28.266672 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3aa6ff-d33c-4d3c-8f09-ca8a4928abeb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:28.266950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3aa6ff-d33c-4d3c-8f09-ca8a4928abeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:28.293199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0b3aa6ff-d33c-4d3c-8f09-ca8a4928abeb None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:28.294914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0b3aa6ff-d33c-4d3c-8f09-ca8a4928abeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:28.382107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de2cfe-73d3-4652-86ce-6bcc78e84fcd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:28.384024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-08de2cfe-73d3-4652-86ce-6bcc78e84fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:28.392298 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1169/2326] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:28.464114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de2cfe-73d3-4652-86ce-6bcc78e84fcd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:28.468933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cde9d4-4393-4a3e-a15e-ae65ffea74ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:28.469666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cde9d4-4393-4a3e-a15e-ae65ffea74ca service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:28.469941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cde9d4-4393-4a3e-a15e-ae65ffea74ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:28.470218 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cde9d4-4393-4a3e-a15e-ae65ffea74ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:28.492085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cde9d4-4393-4a3e-a15e-ae65ffea74ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:28.493595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cde9d4-4393-4a3e-a15e-ae65ffea74ca service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:28.514997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1158/2327] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:14:29.388166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518fc56-a631-418d-a4f2-98d980f76d1b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:29.388725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518fc56-a631-418d-a4f2-98d980f76d1b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:29.388828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518fc56-a631-418d-a4f2-98d980f76d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:29.419421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2518fc56-a631-418d-a4f2-98d980f76d1b None None] MFA Rules not processed for user `a1a6ceb13aa643c8be8a2b58cd571cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:29.421035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2518fc56-a631-418d-a4f2-98d980f76d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:29.552030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1170/2328] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:14:29.584840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cde9d4-4393-4a3e-a15e-ae65ffea74ca service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:29.597239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-44cde9d4-4393-4a3e-a15e-ae65ffea74ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:29.732418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cde9d4-4393-4a3e-a15e-ae65ffea74ca service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:29.746132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819fdbf-90d5-40a0-a2a2-8862c8e8ab76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:29.746956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819fdbf-90d5-40a0-a2a2-8862c8e8ab76 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:29.747337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819fdbf-90d5-40a0-a2a2-8862c8e8ab76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:29.747687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819fdbf-90d5-40a0-a2a2-8862c8e8ab76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:29.760136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819fdbf-90d5-40a0-a2a2-8862c8e8ab76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:29.761960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819fdbf-90d5-40a0-a2a2-8862c8e8ab76 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:29.769646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:29.776930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1159/2329] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:30.976063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbc913-a15b-4ae2-865e-6fa86fbe0408 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:30.976675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbc913-a15b-4ae2-865e-6fa86fbe0408 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:30.976675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbc913-a15b-4ae2-865e-6fa86fbe0408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:30.996480 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2bbbc913-a15b-4ae2-865e-6fa86fbe0408 None None] MFA Rules not processed for user `e7f85468275442b48f2396aa56f7b5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:30.997750 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2bbbc913-a15b-4ae2-865e-6fa86fbe0408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:31.016623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:31.059142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1171/2330] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:31.300736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97014f7b-720f-466a-aa6c-35c628fb6b7b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:31.301835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97014f7b-720f-466a-aa6c-35c628fb6b7b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:31.302432 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97014f7b-720f-466a-aa6c-35c628fb6b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:31.339267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-97014f7b-720f-466a-aa6c-35c628fb6b7b None None] MFA Rules not processed for user `a1a6ceb13aa643c8be8a2b58cd571cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:31.340786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-97014f7b-720f-466a-aa6c-35c628fb6b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:31.363502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1160/2331] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:35.513475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a3dd-e572-4a7f-96bb-e6c40a6e3555 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:35.514096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a3dd-e572-4a7f-96bb-e6c40a6e3555 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:35.514096 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a3dd-e572-4a7f-96bb-e6c40a6e3555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:35.533130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f7a4a3dd-e572-4a7f-96bb-e6c40a6e3555 None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:35.535024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f7a4a3dd-e572-4a7f-96bb-e6c40a6e3555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:35.641797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1172/2332] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:14:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:35.662627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97014f7b-720f-466a-aa6c-35c628fb6b7b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:35.664391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-97014f7b-720f-466a-aa6c-35c628fb6b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:35.758896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97014f7b-720f-466a-aa6c-35c628fb6b7b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:35.763995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb74d7-2e2d-493c-8c50-824c8339c85b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:35.764955 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb74d7-2e2d-493c-8c50-824c8339c85b service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:35.765408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb74d7-2e2d-493c-8c50-824c8339c85b service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:35.765766 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb74d7-2e2d-493c-8c50-824c8339c85b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:35.775718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb74d7-2e2d-493c-8c50-824c8339c85b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:35.777683 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb74d7-2e2d-493c-8c50-824c8339c85b service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:35.795272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1161/2333] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:14:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:14:45.631880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=40 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:45.796880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=35 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:49.808021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4a3dd-e572-4a7f-96bb-e6c40a6e3555 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:49.809692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f7a4a3dd-e572-4a7f-96bb-e6c40a6e3555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:49.827504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4a3dd-e572-4a7f-96bb-e6c40a6e3555 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:49.835602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:49.836661 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:49.836998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:49.837326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] PATH_INFO: `/v3/users/044b5c711fb844cd9810a64333dc7d47` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:49.838832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=044b5c711fb844cd9810a64333dc7d47)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:49.840810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:49.924501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '044b5c711fb844cd9810a64333dc7d47'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:49.934034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '044b5c711fb844cd9810a64333dc7d47'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:49.935007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '044b5c711fb844cd9810a64333dc7d47'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:49.946278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '044b5c711fb844cd9810a64333dc7d47'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:49.946890 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '044b5c711fb844cd9810a64333dc7d47'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:49.971078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1173/2334] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:49 2022] DELETE /identity/v3/users/044b5c711fb844cd9810a64333dc7d47 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:49.975562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7597265-d032-416f-ac38-809c1140ce17 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:49.976531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7597265-d032-416f-ac38-809c1140ce17 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:49.977012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7597265-d032-416f-ac38-809c1140ce17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:49.999328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b7597265-d032-416f-ac38-809c1140ce17 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:50.000783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b7597265-d032-416f-ac38-809c1140ce17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:50.103901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1162/2335] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:14:50.162309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:50.172489 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:50.279863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87bd5-233a-4cf5-b4eb-97c6b1c69c8a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:50.284958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f7830-8444-41d1-9391-3a1bd8def8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:50.285925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f7830-8444-41d1-9391-3a1bd8def8cc service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:50.286205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f7830-8444-41d1-9391-3a1bd8def8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:50.286481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f7830-8444-41d1-9391-3a1bd8def8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:50.299085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f7830-8444-41d1-9391-3a1bd8def8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:50.300715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f7830-8444-41d1-9391-3a1bd8def8cc service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:50.320609 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1174/2336] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:50.557606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5637e1-cd8f-4e53-9018-f6017cab5ded None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:50.557899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5637e1-cd8f-4e53-9018-f6017cab5ded None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:50.558180 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5637e1-cd8f-4e53-9018-f6017cab5ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:50.576605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fb5637e1-cd8f-4e53-9018-f6017cab5ded None None] MFA Rules not processed for user `0a6708681b7549fcba86b5a7f3d0d0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:50.578048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fb5637e1-cd8f-4e53-9018-f6017cab5ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:50.658319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f7830-8444-41d1-9391-3a1bd8def8cc service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:50.660639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a44f7830-8444-41d1-9391-3a1bd8def8cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:50.673633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1163/2337] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:50.693932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f7830-8444-41d1-9391-3a1bd8def8cc service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:50.699548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:50.700769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:50.701372 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:50.702692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] PATH_INFO: `/v3/projects/b856c7149dec4b51bc20f4a41d42c892` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:50.704159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b856c7149dec4b51bc20f4a41d42c892)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:50.707174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:50.764126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b856c7149dec4b51bc20f4a41d42c892', 'request_id': 'req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:50.771152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b856c7149dec4b51bc20f4a41d42c892', 'request_id': 'req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:50.779597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b856c7149dec4b51bc20f4a41d42c892', 'request_id': 'req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:50.786929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:50.795319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] The token cache is being invalidate because project b856c7149dec4b51bc20f4a41d42c892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:50.795802 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:50.796905 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c857b75-dda3-40b9-8e5b-43ee3e20ad97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:50.803865 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1175/2338] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:50 2022] DELETE /identity/v3/projects/b856c7149dec4b51bc20f4a41d42c892 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:50.805701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4ba5-206f-4b1c-8674-d6e2b5415e6a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:50.806003 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4ba5-206f-4b1c-8674-d6e2b5415e6a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:50.806288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4ba5-206f-4b1c-8674-d6e2b5415e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:50.825691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-739e4ba5-206f-4b1c-8674-d6e2b5415e6a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:50.826925 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-739e4ba5-206f-4b1c-8674-d6e2b5415e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:50.903241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1164/2339] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:50.911646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fb9e6-e7a2-402c-8217-cfb745fcbc99 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:50.912020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fb9e6-e7a2-402c-8217-cfb745fcbc99 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:50.912264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fb9e6-e7a2-402c-8217-cfb745fcbc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:50.931525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-468fb9e6-e7a2-402c-8217-cfb745fcbc99 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:50.932944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-468fb9e6-e7a2-402c-8217-cfb745fcbc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:50.941769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1176/2340] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:50.945857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4ba5-206f-4b1c-8674-d6e2b5415e6a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:50.957397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4ba5-206f-4b1c-8674-d6e2b5415e6a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:50.968863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98260d-c53a-4115-b68f-131d77e533f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:50.970505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98260d-c53a-4115-b68f-131d77e533f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:50.970991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98260d-c53a-4115-b68f-131d77e533f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:50.971610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98260d-c53a-4115-b68f-131d77e533f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:50.972867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98260d-c53a-4115-b68f-131d77e533f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:14:50.973529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98260d-c53a-4115-b68f-131d77e533f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:50.976038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98260d-c53a-4115-b68f-131d77e533f5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:50.989550 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1165/2341] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:14:50.993690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fb9e6-e7a2-402c-8217-cfb745fcbc99 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:51.004013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fb9e6-e7a2-402c-8217-cfb745fcbc99 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:51.009910 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07957e-becf-4fab-af8d-3a0a40bbb05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:51.010796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07957e-becf-4fab-af8d-3a0a40bbb05e admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:51.011118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07957e-becf-4fab-af8d-3a0a40bbb05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:51.011395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07957e-becf-4fab-af8d-3a0a40bbb05e admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:51.012173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07957e-becf-4fab-af8d-3a0a40bbb05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:51.015134 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07957e-becf-4fab-af8d-3a0a40bbb05e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:51.051899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1177/2342] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:14:50 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:14:51.052671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98260d-c53a-4115-b68f-131d77e533f5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:51.063295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98260d-c53a-4115-b68f-131d77e533f5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:51.103838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:51.136568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b48ce8-bc20-42be-8caf-a5b114a52f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:51.137157 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48ce8-bc20-42be-8caf-a5b114a52f3e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:51.137469 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48ce8-bc20-42be-8caf-a5b114a52f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:51.137746 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48ce8-bc20-42be-8caf-a5b114a52f3e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:51.138523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b48ce8-bc20-42be-8caf-a5b114a52f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:51.140420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b48ce8-bc20-42be-8caf-a5b114a52f3e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:51.163304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1166/2343] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:14:51 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:14:51.167015 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07957e-becf-4fab-af8d-3a0a40bbb05e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:51.180699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07957e-becf-4fab-af8d-3a0a40bbb05e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:51.185595 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50ea3f-f283-497f-a775-e483dfdc083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:51.186279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50ea3f-f283-497f-a775-e483dfdc083c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:51.186561 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50ea3f-f283-497f-a775-e483dfdc083c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:51.186854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50ea3f-f283-497f-a775-e483dfdc083c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:51.187582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50ea3f-f283-497f-a775-e483dfdc083c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:51.189223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50ea3f-f283-497f-a775-e483dfdc083c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:51.211649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1178/2344] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:51.212039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b48ce8-bc20-42be-8caf-a5b114a52f3e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:51.228936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b48ce8-bc20-42be-8caf-a5b114a52f3e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:51.235208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04946dbc-8ac9-4618-a2f9-f9c1379a504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:51.236045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04946dbc-8ac9-4618-a2f9-f9c1379a504b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:51.236414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04946dbc-8ac9-4618-a2f9-f9c1379a504b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:51.237238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04946dbc-8ac9-4618-a2f9-f9c1379a504b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:51.237779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04946dbc-8ac9-4618-a2f9-f9c1379a504b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:51.239675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04946dbc-8ac9-4618-a2f9-f9c1379a504b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:51.257397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1167/2345] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:14:51.258141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50ea3f-f283-497f-a775-e483dfdc083c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:51.269575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50ea3f-f283-497f-a775-e483dfdc083c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:51.274863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbd73b-1875-48d0-8d56-254b9e28b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:51.275903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbd73b-1875-48d0-8d56-254b9e28b849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:51.276846 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbd73b-1875-48d0-8d56-254b9e28b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:51.277391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbd73b-1875-48d0-8d56-254b9e28b849 admin admin] PATH_INFO: `/v3/projects/8909e5a6ee2a40feb04ab73ca0368e71/users/6137245b4bca40888b74adee9442512b/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:51.297012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbd73b-1875-48d0-8d56-254b9e28b849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8909e5a6ee2a40feb04ab73ca0368e71, user_id=6137245b4bca40888b74adee9442512b, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:51.301247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbd73b-1875-48d0-8d56-254b9e28b849 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:51.331394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1179/2346] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:14:51 2022] PUT /identity/v3/projects/8909e5a6ee2a40feb04ab73ca0368e71/users/6137245b4bca40888b74adee9442512b/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:51.333710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4b9c6-6515-4d65-aab4-edba1d906c61 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:51.334133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4b9c6-6515-4d65-aab4-edba1d906c61 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:51.334377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4b9c6-6515-4d65-aab4-edba1d906c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:51.366080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-05e4b9c6-6515-4d65-aab4-edba1d906c61 None None] MFA Rules not processed for user `6137245b4bca40888b74adee9442512b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:51.366752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-05e4b9c6-6515-4d65-aab4-edba1d906c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:51.453341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1168/2347] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:51.468594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbd73b-1875-48d0-8d56-254b9e28b849 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:51.471626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-69cbd73b-1875-48d0-8d56-254b9e28b849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:51.550206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbd73b-1875-48d0-8d56-254b9e28b849 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:51.554658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8f21b-0302-4b78-b1b1-5a6ad789485f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:51.555405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8f21b-0302-4b78-b1b1-5a6ad789485f service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:51.555728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8f21b-0302-4b78-b1b1-5a6ad789485f service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:51.556084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8f21b-0302-4b78-b1b1-5a6ad789485f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:51.569371 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8f21b-0302-4b78-b1b1-5a6ad789485f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:51.570982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8f21b-0302-4b78-b1b1-5a6ad789485f service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:51.581723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1180/2348] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:14:53.111725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a67c9-6955-45ef-9802-b6d6f8dff4cd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:53.112777 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a67c9-6955-45ef-9802-b6d6f8dff4cd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:53.113340 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a67c9-6955-45ef-9802-b6d6f8dff4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:53.147389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c17a67c9-6955-45ef-9802-b6d6f8dff4cd None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:53.149072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c17a67c9-6955-45ef-9802-b6d6f8dff4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:53.308304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1169/2349] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:14:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:14:53.323935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8f21b-0302-4b78-b1b1-5a6ad789485f service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:53.326791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5cf8f21b-0302-4b78-b1b1-5a6ad789485f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:53.560866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8f21b-0302-4b78-b1b1-5a6ad789485f service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:53.567931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42207b3a-5ef6-48bf-8959-75f8e1743424 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:53.568231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42207b3a-5ef6-48bf-8959-75f8e1743424 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:53.568515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42207b3a-5ef6-48bf-8959-75f8e1743424 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:53.568795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42207b3a-5ef6-48bf-8959-75f8e1743424 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:53.576369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:53.579242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42207b3a-5ef6-48bf-8959-75f8e1743424 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:53.581232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42207b3a-5ef6-48bf-8959-75f8e1743424 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:53.608769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1181/2350] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:14:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:14:54.554462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a67c9-6955-45ef-9802-b6d6f8dff4cd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:54.556348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c17a67c9-6955-45ef-9802-b6d6f8dff4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:54.612534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:54.882306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a67c9-6955-45ef-9802-b6d6f8dff4cd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:54.894143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:54.895126 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:54.895595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:54.896049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] PATH_INFO: `/v3/users/ec2682cf98ea42fe989d795eac872dbd` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:54.901575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec2682cf98ea42fe989d795eac872dbd)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:54.909787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:55.007323 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec2682cf98ea42fe989d795eac872dbd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:55.018485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec2682cf98ea42fe989d795eac872dbd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:55.019930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec2682cf98ea42fe989d795eac872dbd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:55.030906 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec2682cf98ea42fe989d795eac872dbd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:55.046570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec2682cf98ea42fe989d795eac872dbd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:55.053976 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1170/2351] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:14:54 2022] DELETE /identity/v3/users/ec2682cf98ea42fe989d795eac872dbd => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:14:55.058147 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7003d5-987c-4a0c-8df8-632caf08bff2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:55.058681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7003d5-987c-4a0c-8df8-632caf08bff2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:55.058906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7003d5-987c-4a0c-8df8-632caf08bff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:55.121827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ad7003d5-987c-4a0c-8df8-632caf08bff2 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:14:55.123108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ad7003d5-987c-4a0c-8df8-632caf08bff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:55.339627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1182/2352] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:14:55.347737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:55.349423 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:55.505742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:55.510698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbe6f8-a98d-431d-ad93-ab123c65ee6e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:55.524495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d57a77-f03b-4581-9bac-138c69c9d6a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:55.525190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d57a77-f03b-4581-9bac-138c69c9d6a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:55.525556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d57a77-f03b-4581-9bac-138c69c9d6a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:55.525936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d57a77-f03b-4581-9bac-138c69c9d6a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:55.548615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d57a77-f03b-4581-9bac-138c69c9d6a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:55.551050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d57a77-f03b-4581-9bac-138c69c9d6a1 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:55.579390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1171/2353] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:14:56.437912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7003d5-987c-4a0c-8df8-632caf08bff2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:14:56.439422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ad7003d5-987c-4a0c-8df8-632caf08bff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:14:56.462325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7003d5-987c-4a0c-8df8-632caf08bff2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:14:56.482077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:14:56.483422 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:14:56.483918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:14:56.484406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] PATH_INFO: `/v3/projects/addde912245d4f29922db097142f0f23` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:14:56.486041 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=addde912245d4f29922db097142f0f23)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:14:56.488298 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:14:56.600006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'addde912245d4f29922db097142f0f23', 'request_id': 'req-f9f9c605-e46a-4259-a934-86700b12a000'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:56.615294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'addde912245d4f29922db097142f0f23', 'request_id': 'req-f9f9c605-e46a-4259-a934-86700b12a000'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:56.648610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'addde912245d4f29922db097142f0f23', 'request_id': 'req-f9f9c605-e46a-4259-a934-86700b12a000'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:56.670944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] The token cache is being invalidate because project addde912245d4f29922db097142f0f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:14:56.671523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:56.682040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:14:56.697522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1183/2354] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:14:56 2022] DELETE /identity/v3/projects/addde912245d4f29922db097142f0f23 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:15:04.572986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e3536-6e07-4b1c-9088-d1cc32a579d9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:04.573547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e3536-6e07-4b1c-9088-d1cc32a579d9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:04.573547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e3536-6e07-4b1c-9088-d1cc32a579d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:04.592407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-655e3536-6e07-4b1c-9088-d1cc32a579d9 None None] MFA Rules not processed for user `a1a6ceb13aa643c8be8a2b58cd571cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:04.594198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-655e3536-6e07-4b1c-9088-d1cc32a579d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:04.662708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1172/2355] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:15:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:04.866039 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:04.868503 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:05.057720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9c605-e46a-4259-a934-86700b12a000 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:05.064132 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:05.066801 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:05.067610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:05.068914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] PATH_INFO: `/v3/users/6137245b4bca40888b74adee9442512b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:05.078486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6137245b4bca40888b74adee9442512b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:05.085858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:05.124569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:05.194965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6137245b4bca40888b74adee9442512b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:05.204771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6137245b4bca40888b74adee9442512b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:05.206098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6137245b4bca40888b74adee9442512b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:05.224695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6137245b4bca40888b74adee9442512b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:05.228367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6137245b4bca40888b74adee9442512b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:05.282569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1184/2356] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:15:04 2022] DELETE /identity/v3/users/6137245b4bca40888b74adee9442512b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:15:05.287387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4282cd-2025-4b81-94ce-3443e288309b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:05.287680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4282cd-2025-4b81-94ce-3443e288309b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:05.287962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4282cd-2025-4b81-94ce-3443e288309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:05.318510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2a4282cd-2025-4b81-94ce-3443e288309b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:05.319656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2a4282cd-2025-4b81-94ce-3443e288309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:05.443262 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1173/2357] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:05.455551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:05.457069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:05.647133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e1693-8db1-4bf4-aa1d-5a491aa3a338 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:05.662122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e3d1a-0e06-41a1-86ff-ee34de52ca36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:05.663034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3d1a-0e06-41a1-86ff-ee34de52ca36 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:05.663486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3d1a-0e06-41a1-86ff-ee34de52ca36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:05.663909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3d1a-0e06-41a1-86ff-ee34de52ca36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:05.704972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e3d1a-0e06-41a1-86ff-ee34de52ca36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:05.706838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e3d1a-0e06-41a1-86ff-ee34de52ca36 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:05.740161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1185/2358] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:15:06.789893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4282cd-2025-4b81-94ce-3443e288309b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:06.789893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2a4282cd-2025-4b81-94ce-3443e288309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:06.811004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4282cd-2025-4b81-94ce-3443e288309b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:06.818468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:06.819722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:06.820092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:06.820469 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] PATH_INFO: `/v3/projects/8909e5a6ee2a40feb04ab73ca0368e71` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:06.822190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8909e5a6ee2a40feb04ab73ca0368e71)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:06.824956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:06.936753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8909e5a6ee2a40feb04ab73ca0368e71', 'request_id': 'req-31434192-1614-4182-affe-0f9ce561aa5c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:06.948559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8909e5a6ee2a40feb04ab73ca0368e71', 'request_id': 'req-31434192-1614-4182-affe-0f9ce561aa5c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:06.963719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8909e5a6ee2a40feb04ab73ca0368e71', 'request_id': 'req-31434192-1614-4182-affe-0f9ce561aa5c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:07.015009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] The token cache is being invalidate because project 8909e5a6ee2a40feb04ab73ca0368e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:15:07.015732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:07.017147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-31434192-1614-4182-affe-0f9ce561aa5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:07.026002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1174/2359] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:15:06 2022] DELETE /identity/v3/projects/8909e5a6ee2a40feb04ab73ca0368e71 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:15:07.030602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4bff8-801f-4f82-be99-2cce3095558b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:07.031504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4bff8-801f-4f82-be99-2cce3095558b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:07.031931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4bff8-801f-4f82-be99-2cce3095558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:07.190049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e1d4bff8-801f-4f82-be99-2cce3095558b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:07.192056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e1d4bff8-801f-4f82-be99-2cce3095558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:07.351617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1186/2360] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:07.361048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac144dd-2d10-4f86-9ec4-5e98a0cbbabe None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:07.361349 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac144dd-2d10-4f86-9ec4-5e98a0cbbabe None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:07.361986 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac144dd-2d10-4f86-9ec4-5e98a0cbbabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:07.396547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cac144dd-2d10-4f86-9ec4-5e98a0cbbabe None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:07.398786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cac144dd-2d10-4f86-9ec4-5e98a0cbbabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:07.414317 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1175/2361] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:07.418715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4bff8-801f-4f82-be99-2cce3095558b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:07.441796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4bff8-801f-4f82-be99-2cce3095558b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:07.454942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ce028-baab-45f9-b738-c92ff3d4923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:07.454942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ce028-baab-45f9-b738-c92ff3d4923c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:07.454942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ce028-baab-45f9-b738-c92ff3d4923c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:07.454942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ce028-baab-45f9-b738-c92ff3d4923c admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:07.455504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ce028-baab-45f9-b738-c92ff3d4923c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:15:07.455504 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ce028-baab-45f9-b738-c92ff3d4923c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:07.471122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ce028-baab-45f9-b738-c92ff3d4923c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:07.485494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:07.511348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac144dd-2d10-4f86-9ec4-5e98a0cbbabe None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:07.519075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1187/2362] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:15:07.524413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac144dd-2d10-4f86-9ec4-5e98a0cbbabe None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:07.538698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f254b-b5b3-432e-9a6d-fa2fc7eaf0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:07.539936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f254b-b5b3-432e-9a6d-fa2fc7eaf0ea admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:07.540241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f254b-b5b3-432e-9a6d-fa2fc7eaf0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:07.540556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f254b-b5b3-432e-9a6d-fa2fc7eaf0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:07.541996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f254b-b5b3-432e-9a6d-fa2fc7eaf0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:07.546571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f254b-b5b3-432e-9a6d-fa2fc7eaf0ea admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:07.572185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:07.634978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1176/2363] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:15:07 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:15:07.639556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ce028-baab-45f9-b738-c92ff3d4923c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:07.655035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ce028-baab-45f9-b738-c92ff3d4923c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:07.828411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99aba2-7c44-42dc-aec5-8eaf2ed9a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:07.829715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99aba2-7c44-42dc-aec5-8eaf2ed9a347 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:07.829715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99aba2-7c44-42dc-aec5-8eaf2ed9a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:07.829715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99aba2-7c44-42dc-aec5-8eaf2ed9a347 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:07.830523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99aba2-7c44-42dc-aec5-8eaf2ed9a347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:07.833553 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99aba2-7c44-42dc-aec5-8eaf2ed9a347 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:07.866485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1188/2364] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:15:07 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:15:07.870818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f254b-b5b3-432e-9a6d-fa2fc7eaf0ea admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:07.884232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f254b-b5b3-432e-9a6d-fa2fc7eaf0ea admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:07.895689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f97165-57cc-4340-8551-75eced02c0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:07.896394 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97165-57cc-4340-8551-75eced02c0bf admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:07.896681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97165-57cc-4340-8551-75eced02c0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:07.897004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97165-57cc-4340-8551-75eced02c0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:07.897854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f97165-57cc-4340-8551-75eced02c0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:07.899512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f97165-57cc-4340-8551-75eced02c0bf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:07.912096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1177/2365] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:15:07.916925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99aba2-7c44-42dc-aec5-8eaf2ed9a347 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:07.929944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99aba2-7c44-42dc-aec5-8eaf2ed9a347 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:07.935891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a909278-4e3b-4064-82f0-46de00dbbd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:07.936878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909278-4e3b-4064-82f0-46de00dbbd3f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:07.937402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909278-4e3b-4064-82f0-46de00dbbd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:07.937864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909278-4e3b-4064-82f0-46de00dbbd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:07.938744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a909278-4e3b-4064-82f0-46de00dbbd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:07.940785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a909278-4e3b-4064-82f0-46de00dbbd3f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:07.960181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1189/2366] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:15:07.966622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f97165-57cc-4340-8551-75eced02c0bf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:07.982685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f97165-57cc-4340-8551-75eced02c0bf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:07.988010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423a53-a7ee-403b-962d-882bab8979be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:07.989436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423a53-a7ee-403b-962d-882bab8979be admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:07.990215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423a53-a7ee-403b-962d-882bab8979be admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:07.990851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423a53-a7ee-403b-962d-882bab8979be admin admin] PATH_INFO: `/v3/projects/da01846597764c1f8ac28f93199fdc5e/users/09fb1c9f461a416f96ec3c6728eee901/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:08.014926 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423a53-a7ee-403b-962d-882bab8979be admin admin] RBAC: Authorizing `identity:create_grant(project_id=da01846597764c1f8ac28f93199fdc5e, user_id=09fb1c9f461a416f96ec3c6728eee901, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:08.018824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423a53-a7ee-403b-962d-882bab8979be admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:08.055004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1178/2367] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:15:07 2022] PUT /identity/v3/projects/da01846597764c1f8ac28f93199fdc5e/users/09fb1c9f461a416f96ec3c6728eee901/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:15:08.066000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c2385-881e-4e49-ac45-95d4fe829b4b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:08.066806 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c2385-881e-4e49-ac45-95d4fe829b4b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:08.067244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c2385-881e-4e49-ac45-95d4fe829b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:08.105817 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7a3c2385-881e-4e49-ac45-95d4fe829b4b None None] MFA Rules not processed for user `09fb1c9f461a416f96ec3c6728eee901`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:08.107913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7a3c2385-881e-4e49-ac45-95d4fe829b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:08.241482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1190/2368] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:15:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:08.242093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423a53-a7ee-403b-962d-882bab8979be admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:08.242866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1423a53-a7ee-403b-962d-882bab8979be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:08.327675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423a53-a7ee-403b-962d-882bab8979be admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:08.331829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729456c5-d384-45c0-858a-6dca08e74f9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b74d07fba34715a488539d630b0bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:08.332504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729456c5-d384-45c0-858a-6dca08e74f9a service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:08.332782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729456c5-d384-45c0-858a-6dca08e74f9a service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:08.333023 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729456c5-d384-45c0-858a-6dca08e74f9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:08.342706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729456c5-d384-45c0-858a-6dca08e74f9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:08.344267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729456c5-d384-45c0-858a-6dca08e74f9a service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:08.356299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1179/2369] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:15:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:15:11.915207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c2385-881e-4e49-ac45-95d4fe829b4b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:11.916728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7a3c2385-881e-4e49-ac45-95d4fe829b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:11.979763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c2385-881e-4e49-ac45-95d4fe829b4b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:11.983631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575aa78-8dc9-4735-8c0e-96bf297eabd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:11.984279 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575aa78-8dc9-4735-8c0e-96bf297eabd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:11.984556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575aa78-8dc9-4735-8c0e-96bf297eabd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:11.984825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575aa78-8dc9-4735-8c0e-96bf297eabd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:11.986728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2575aa78-8dc9-4735-8c0e-96bf297eabd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:12.007664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:12.064387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575aa78-8dc9-4735-8c0e-96bf297eabd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:12.066325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575aa78-8dc9-4735-8c0e-96bf297eabd5 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:12.077772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1191/2370] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:15:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:15:14.530828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e003-7f4a-499e-8bda-6f31eb3d0e15 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:14.531398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e003-7f4a-499e-8bda-6f31eb3d0e15 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:14.531398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e003-7f4a-499e-8bda-6f31eb3d0e15 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:14.532988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1180/2371] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:15:14.540570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6fa03-87c7-4893-917f-a06e32a2d705 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:14.541749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6fa03-87c7-4893-917f-a06e32a2d705 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:14.542253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6fa03-87c7-4893-917f-a06e32a2d705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:14.577636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7de6fa03-87c7-4893-917f-a06e32a2d705 None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:14.578930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7de6fa03-87c7-4893-917f-a06e32a2d705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:14.662656 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1192/2372] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:15:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:15:14.676475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e003-7f4a-499e-8bda-6f31eb3d0e15 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:14.688623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e003-7f4a-499e-8bda-6f31eb3d0e15 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:14.692208 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64479368-9f5a-4947-bfd3-0a3ce9a2864f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b74d07fba34715a488539d630b0bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:14.692858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64479368-9f5a-4947-bfd3-0a3ce9a2864f service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:14.693136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64479368-9f5a-4947-bfd3-0a3ce9a2864f service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:14.693448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64479368-9f5a-4947-bfd3-0a3ce9a2864f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:14.704671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64479368-9f5a-4947-bfd3-0a3ce9a2864f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:14.706176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64479368-9f5a-4947-bfd3-0a3ce9a2864f service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:14.717601 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1181/2373] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:15:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:15:14.798386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4758ab-4997-4db6-8f39-c3f4dd09c9d5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:14.798741 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4758ab-4997-4db6-8f39-c3f4dd09c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:14.801589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4758ab-4997-4db6-8f39-c3f4dd09c9d5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:14.803972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1193/2374] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:15:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:15:14.810170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb207ebd-2d77-4547-9654-e4e946bcb190 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:14.810460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb207ebd-2d77-4547-9654-e4e946bcb190 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:14.810785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb207ebd-2d77-4547-9654-e4e946bcb190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:14.834628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fb207ebd-2d77-4547-9654-e4e946bcb190 None None] MFA Rules not processed for user `20745118f9eb436096a323ba2d22e94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:14.836149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fb207ebd-2d77-4547-9654-e4e946bcb190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:14.842881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1182/2375] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:15:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:15:14.855635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4758ab-4997-4db6-8f39-c3f4dd09c9d5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:14.869008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4758ab-4997-4db6-8f39-c3f4dd09c9d5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:14.872587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020f4e3-d496-4638-b90b-b2921f095b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:14.873294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020f4e3-d496-4638-b90b-b2921f095b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:14.873687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020f4e3-d496-4638-b90b-b2921f095b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:14.873966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020f4e3-d496-4638-b90b-b2921f095b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:14.882631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020f4e3-d496-4638-b90b-b2921f095b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:14.884291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020f4e3-d496-4638-b90b-b2921f095b46 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:14.893677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1194/2376] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:15:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:15:14.979640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae8aa-b1a5-403e-8298-bf01735e595e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:14.979976 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae8aa-b1a5-403e-8298-bf01735e595e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:14.980206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae8aa-b1a5-403e-8298-bf01735e595e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:14.981662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1183/2377] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:15:14.987961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc224fdf-2c92-4f06-a0a8-899c2138ffa2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:14.988338 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc224fdf-2c92-4f06-a0a8-899c2138ffa2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:14.988650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc224fdf-2c92-4f06-a0a8-899c2138ffa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:15.008189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dc224fdf-2c92-4f06-a0a8-899c2138ffa2 None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:15.009555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dc224fdf-2c92-4f06-a0a8-899c2138ffa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:15.030580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1195/2378] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:15:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:15.037590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ae8aa-b1a5-403e-8298-bf01735e595e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:15.051960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ae8aa-b1a5-403e-8298-bf01735e595e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:15.060297 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144aec2-e545-41c0-9b3f-45bad1358294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:15.061168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144aec2-e545-41c0-9b3f-45bad1358294 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:15.061623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144aec2-e545-41c0-9b3f-45bad1358294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:15.061999 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144aec2-e545-41c0-9b3f-45bad1358294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:15.076650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144aec2-e545-41c0-9b3f-45bad1358294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:15.082637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144aec2-e545-41c0-9b3f-45bad1358294 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:15.107899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1184/2379] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:15:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:15:18.869224 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18a56b-a883-4322-ac3a-f5b4c216a368 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:18.869712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18a56b-a883-4322-ac3a-f5b4c216a368 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:18.869815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18a56b-a883-4322-ac3a-f5b4c216a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:18.889774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1d18a56b-a883-4322-ac3a-f5b4c216a368 None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:18.891000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1d18a56b-a883-4322-ac3a-f5b4c216a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:18.960354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1196/2380] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:15:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:18.983494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144aec2-e545-41c0-9b3f-45bad1358294 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:18.984973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d144aec2-e545-41c0-9b3f-45bad1358294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:19.058112 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144aec2-e545-41c0-9b3f-45bad1358294 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:19.063960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35f1fe-a593-4672-b865-d7b723c39d0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:19.064611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35f1fe-a593-4672-b865-d7b723c39d0c service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:19.064889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35f1fe-a593-4672-b865-d7b723c39d0c service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:19.065161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35f1fe-a593-4672-b865-d7b723c39d0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:19.075210 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35f1fe-a593-4672-b865-d7b723c39d0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:19.077202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35f1fe-a593-4672-b865-d7b723c39d0c service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:19.085712 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1185/2381] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:15:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:15:28.951017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:29.082271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:33.360455 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18a56b-a883-4322-ac3a-f5b4c216a368 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:33.428222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18a56b-a883-4322-ac3a-f5b4c216a368 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:33.433680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:33.434559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:33.434839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:33.435110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] PATH_INFO: `/v3/users/09fb1c9f461a416f96ec3c6728eee901` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:33.436403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fb1c9f461a416f96ec3c6728eee901)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:33.438397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:33.489883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fb1c9f461a416f96ec3c6728eee901'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:33.497540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fb1c9f461a416f96ec3c6728eee901'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:33.498313 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fb1c9f461a416f96ec3c6728eee901'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:33.507425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fb1c9f461a416f96ec3c6728eee901'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:33.508090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fb1c9f461a416f96ec3c6728eee901'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:33.527930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1197/2382] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:15:33 2022] DELETE /identity/v3/users/09fb1c9f461a416f96ec3c6728eee901 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:15:33.532379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803eacb-865e-4651-a304-fcdbae658c78 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:33.532918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803eacb-865e-4651-a304-fcdbae658c78 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:33.532918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803eacb-865e-4651-a304-fcdbae658c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:33.551885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5803eacb-865e-4651-a304-fcdbae658c78 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:33.554982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5803eacb-865e-4651-a304-fcdbae658c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:33.628776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1186/2383] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:33.638766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:33.640755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:33.721614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe50362-cde2-4514-be7b-7d96d8467bc3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:33.725524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e471e65-462d-40fc-b017-b69abd736135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:33.726172 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e471e65-462d-40fc-b017-b69abd736135 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:33.726449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e471e65-462d-40fc-b017-b69abd736135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:33.726720 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e471e65-462d-40fc-b017-b69abd736135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:33.736221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e471e65-462d-40fc-b017-b69abd736135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:33.737674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e471e65-462d-40fc-b017-b69abd736135 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:33.747085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1198/2384] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:15:34.060991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803eacb-865e-4651-a304-fcdbae658c78 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:34.062590 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5803eacb-865e-4651-a304-fcdbae658c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:34.078923 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803eacb-865e-4651-a304-fcdbae658c78 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:34.084523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:34.085575 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:34.085898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:34.086160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] PATH_INFO: `/v3/projects/da01846597764c1f8ac28f93199fdc5e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:34.087500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da01846597764c1f8ac28f93199fdc5e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:34.089599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:34.144318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da01846597764c1f8ac28f93199fdc5e', 'request_id': 'req-d78cb6e5-e980-4771-a070-b885caccb695'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:34.151869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da01846597764c1f8ac28f93199fdc5e', 'request_id': 'req-d78cb6e5-e980-4771-a070-b885caccb695'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:34.160710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da01846597764c1f8ac28f93199fdc5e', 'request_id': 'req-d78cb6e5-e980-4771-a070-b885caccb695'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:34.172305 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] The token cache is being invalidate because project da01846597764c1f8ac28f93199fdc5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:15:34.172591 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:34.173279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:15:34.174841 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1187/2385] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:15:34 2022] DELETE /identity/v3/projects/da01846597764c1f8ac28f93199fdc5e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:15:40.031688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb52b37-3224-4c0f-8bdc-dff3f80ecfc0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:40.032142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb52b37-3224-4c0f-8bdc-dff3f80ecfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:40.032229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb52b37-3224-4c0f-8bdc-dff3f80ecfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:40.051229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:40.052143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2fb52b37-3224-4c0f-8bdc-dff3f80ecfc0 None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:40.052895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:40.053483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2fb52b37-3224-4c0f-8bdc-dff3f80ecfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:40.079452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:40.121834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1199/2386] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 17 15:15:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:40.135139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb52b37-3224-4c0f-8bdc-dff3f80ecfc0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:40.135982 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2fb52b37-3224-4c0f-8bdc-dff3f80ecfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:40.156836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cb6e5-e980-4771-a070-b885caccb695 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:40.163002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda7f2a-dddb-465d-b89d-aa586ea1fca1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:40.163671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda7f2a-dddb-465d-b89d-aa586ea1fca1 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:40.163950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda7f2a-dddb-465d-b89d-aa586ea1fca1 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:40.164223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda7f2a-dddb-465d-b89d-aa586ea1fca1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:40.166207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2fda7f2a-dddb-465d-b89d-aa586ea1fca1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:40.174728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:40.180100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda7f2a-dddb-465d-b89d-aa586ea1fca1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:40.181850 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda7f2a-dddb-465d-b89d-aa586ea1fca1 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:40.192528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1188/2387] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:15:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:15:40.206963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb52b37-3224-4c0f-8bdc-dff3f80ecfc0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:40.212626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1cb41-cc21-40d9-86ae-ecab5db3d3ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:40.213413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1cb41-cc21-40d9-86ae-ecab5db3d3ad service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:40.213703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1cb41-cc21-40d9-86ae-ecab5db3d3ad service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:40.214007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1cb41-cc21-40d9-86ae-ecab5db3d3ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:40.223657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1cb41-cc21-40d9-86ae-ecab5db3d3ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:40.225427 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1cb41-cc21-40d9-86ae-ecab5db3d3ad service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:40.234120 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1200/2388] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:15:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 15:15:43.063009 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2712ba-0599-4cc8-bd30-c4c92c8df145 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:43.063513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2712ba-0599-4cc8-bd30-c4c92c8df145 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:43.063627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2712ba-0599-4cc8-bd30-c4c92c8df145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:43.119324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0e2712ba-0599-4cc8-bd30-c4c92c8df145 None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:43.120547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0e2712ba-0599-4cc8-bd30-c4c92c8df145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:43.138803 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1189/2389] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:15:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:43.152261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1cb41-cc21-40d9-86ae-ecab5db3d3ad service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:43.173541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1cb41-cc21-40d9-86ae-ecab5db3d3ad service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:43.179660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef7da-93ce-4b6a-9ca7-d7cdff242056 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:43.180302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef7da-93ce-4b6a-9ca7-d7cdff242056 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:43.180584 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef7da-93ce-4b6a-9ca7-d7cdff242056 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:43.180880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef7da-93ce-4b6a-9ca7-d7cdff242056 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:43.189220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef7da-93ce-4b6a-9ca7-d7cdff242056 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:43.190809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef7da-93ce-4b6a-9ca7-d7cdff242056 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:43.199207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1201/2390] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:15:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:15:53.135454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=21 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:53.199396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=57 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:58.850506 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeba37-4335-4c69-bfcd-7f35bf618edd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:58.851012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeba37-4335-4c69-bfcd-7f35bf618edd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:58.851131 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeba37-4335-4c69-bfcd-7f35bf618edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:58.870214 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-02aeba37-4335-4c69-bfcd-7f35bf618edd None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:15:58.871553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-02aeba37-4335-4c69-bfcd-7f35bf618edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:15:58.879207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1190/2391] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 17 15:15:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:15:58.892863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef7da-93ce-4b6a-9ca7-d7cdff242056 service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:15:58.903985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef7da-93ce-4b6a-9ca7-d7cdff242056 service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:15:58.909560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8e740-97f3-41f4-b779-46a144f6e9ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:15:58.910232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8e740-97f3-41f4-b779-46a144f6e9ab service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:15:58.910513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8e740-97f3-41f4-b779-46a144f6e9ab service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:15:58.910792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8e740-97f3-41f4-b779-46a144f6e9ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:15:58.919260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8e740-97f3-41f4-b779-46a144f6e9ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:15:58.921051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8e740-97f3-41f4-b779-46a144f6e9ab service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:15:58.929162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1202/2392] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:15:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:16:01.323646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aeba37-4335-4c69-bfcd-7f35bf618edd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:01.325099 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-02aeba37-4335-4c69-bfcd-7f35bf618edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:01.398195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aeba37-4335-4c69-bfcd-7f35bf618edd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:01.402718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:01.403839 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:01.404119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:01.404397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] PATH_INFO: `/v3/users/a1a6ceb13aa643c8be8a2b58cd571cf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:01.405635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a6ceb13aa643c8be8a2b58cd571cf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:01.407572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:01.460341 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a6ceb13aa643c8be8a2b58cd571cf1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:16:01.467434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a6ceb13aa643c8be8a2b58cd571cf1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:16:01.468192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a6ceb13aa643c8be8a2b58cd571cf1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:16:01.477674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a6ceb13aa643c8be8a2b58cd571cf1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:16:01.489856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4896e960-7db9-4fc5-ad12-c51f690d5687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a6ceb13aa643c8be8a2b58cd571cf1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:16:01.495776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1191/2393] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:16:01 2022] DELETE /identity/v3/users/a1a6ceb13aa643c8be8a2b58cd571cf1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:16:01.735378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8e740-97f3-41f4-b779-46a144f6e9ab service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:01.746651 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8e740-97f3-41f4-b779-46a144f6e9ab service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:01.824888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:01.825803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:01.826085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:01.826694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] PATH_INFO: `/v3/projects/163ae885b74946a393a4dd1121a0c98c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:01.827953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=163ae885b74946a393a4dd1121a0c98c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:01.829901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:01.881033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163ae885b74946a393a4dd1121a0c98c', 'request_id': 'req-fd45411b-de2f-4f0f-b356-c171791ed0bb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:16:01.888044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163ae885b74946a393a4dd1121a0c98c', 'request_id': 'req-fd45411b-de2f-4f0f-b356-c171791ed0bb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:16:01.896971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163ae885b74946a393a4dd1121a0c98c', 'request_id': 'req-fd45411b-de2f-4f0f-b356-c171791ed0bb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:16:01.908144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] The token cache is being invalidate because project 163ae885b74946a393a4dd1121a0c98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:16:01.908481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:16:01.909216 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd45411b-de2f-4f0f-b356-c171791ed0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:16:01.912019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1203/2394] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:16:01 2022] DELETE /identity/v3/projects/163ae885b74946a393a4dd1121a0c98c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:16:01.917474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f44ad-625d-4a05-b976-546a019ddebc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:01.917854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f44ad-625d-4a05-b976-546a019ddebc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:01.918200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f44ad-625d-4a05-b976-546a019ddebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:01.937270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-295f44ad-625d-4a05-b976-546a019ddebc None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:01.938551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-295f44ad-625d-4a05-b976-546a019ddebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:02.003702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1192/2395] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:02.012125 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c40d3-6fd3-4860-8662-cd46bfae6491 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:02.012415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c40d3-6fd3-4860-8662-cd46bfae6491 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:02.012692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c40d3-6fd3-4860-8662-cd46bfae6491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:02.034004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a61c40d3-6fd3-4860-8662-cd46bfae6491 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:02.035235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a61c40d3-6fd3-4860-8662-cd46bfae6491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:02.044328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1204/2396] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:02.048741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f44ad-625d-4a05-b976-546a019ddebc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:02.059217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f44ad-625d-4a05-b976-546a019ddebc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:02.065921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2f5d-5f49-487f-b557-90367b389c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:02.068408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2f5d-5f49-487f-b557-90367b389c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:02.068767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2f5d-5f49-487f-b557-90367b389c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:02.069147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2f5d-5f49-487f-b557-90367b389c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:02.069921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2f5d-5f49-487f-b557-90367b389c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:16:02.070256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2f5d-5f49-487f-b557-90367b389c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:02.071945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2f5d-5f49-487f-b557-90367b389c99 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:02.081611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:02.086190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1193/2397] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:16:02.091075 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c40d3-6fd3-4860-8662-cd46bfae6491 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:02.100955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c40d3-6fd3-4860-8662-cd46bfae6491 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:02.105814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e2521-e08d-4ff1-abba-a454697bfd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:02.106538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e2521-e08d-4ff1-abba-a454697bfd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:02.106877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e2521-e08d-4ff1-abba-a454697bfd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:02.107210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e2521-e08d-4ff1-abba-a454697bfd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:02.107906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e2521-e08d-4ff1-abba-a454697bfd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:02.109851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e2521-e08d-4ff1-abba-a454697bfd40 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:02.164364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1205/2398] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:16:02 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:16:02.167358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2f5d-5f49-487f-b557-90367b389c99 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:02.181346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2f5d-5f49-487f-b557-90367b389c99 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:02.240916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed3353-8527-404b-8732-9a533a104d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:02.241737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed3353-8527-404b-8732-9a533a104d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:02.242021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed3353-8527-404b-8732-9a533a104d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:02.242298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed3353-8527-404b-8732-9a533a104d68 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:02.243010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed3353-8527-404b-8732-9a533a104d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:02.245008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed3353-8527-404b-8732-9a533a104d68 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:02.271413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1194/2399] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:16:02 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:16:02.272726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e2521-e08d-4ff1-abba-a454697bfd40 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:02.284163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e2521-e08d-4ff1-abba-a454697bfd40 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:02.289838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b53b28-ce75-4277-8be5-ec91a5e94cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:02.290541 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b53b28-ce75-4277-8be5-ec91a5e94cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:02.290824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b53b28-ce75-4277-8be5-ec91a5e94cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:02.291263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b53b28-ce75-4277-8be5-ec91a5e94cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:02.292013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b53b28-ce75-4277-8be5-ec91a5e94cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:02.293698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b53b28-ce75-4277-8be5-ec91a5e94cc7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:02.305729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1206/2400] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:16:02.309997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed3353-8527-404b-8732-9a533a104d68 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:02.321616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed3353-8527-404b-8732-9a533a104d68 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:02.329358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0fcd-b97a-4c47-a3e8-3fc96cda5d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:02.330075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0fcd-b97a-4c47-a3e8-3fc96cda5d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:02.330445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0fcd-b97a-4c47-a3e8-3fc96cda5d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:02.330775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0fcd-b97a-4c47-a3e8-3fc96cda5d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:02.332694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0fcd-b97a-4c47-a3e8-3fc96cda5d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:02.334808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0fcd-b97a-4c47-a3e8-3fc96cda5d91 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:02.351327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1195/2401] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:16:02.352052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b53b28-ce75-4277-8be5-ec91a5e94cc7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:02.366597 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b53b28-ce75-4277-8be5-ec91a5e94cc7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:02.372193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b9e96-1324-43f4-9653-1cea43c2b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:02.373113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b9e96-1324-43f4-9653-1cea43c2b0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:02.373429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b9e96-1324-43f4-9653-1cea43c2b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:02.373710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b9e96-1324-43f4-9653-1cea43c2b0fb admin admin] PATH_INFO: `/v3/projects/1ecf4dbce5d341aa8c75518e75b5f6d1/users/be4c6ca1cde040c5b3cf0f84789ca4ab/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:02.392193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b9e96-1324-43f4-9653-1cea43c2b0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecf4dbce5d341aa8c75518e75b5f6d1, user_id=be4c6ca1cde040c5b3cf0f84789ca4ab, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:02.395098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b9e96-1324-43f4-9653-1cea43c2b0fb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:02.413175 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1207/2402] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:16:02 2022] PUT /identity/v3/projects/1ecf4dbce5d341aa8c75518e75b5f6d1/users/be4c6ca1cde040c5b3cf0f84789ca4ab/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:16:02.418307 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cbf44-9477-4297-9359-6a925a9a13a3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:02.418621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cbf44-9477-4297-9359-6a925a9a13a3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:02.418856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cbf44-9477-4297-9359-6a925a9a13a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:02.438594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-005cbf44-9477-4297-9359-6a925a9a13a3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:02.440534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-005cbf44-9477-4297-9359-6a925a9a13a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:02.523828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1196/2403] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:02.561052 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b9e96-1324-43f4-9653-1cea43c2b0fb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:02.564535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1c0b9e96-1324-43f4-9653-1cea43c2b0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:02.591997 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:02.687137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b9e96-1324-43f4-9653-1cea43c2b0fb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:02.691727 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abbd63-f759-4ea1-ad8f-c6133570533d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:02.692799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abbd63-f759-4ea1-ad8f-c6133570533d service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:02.693412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abbd63-f759-4ea1-ad8f-c6133570533d service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:02.693842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abbd63-f759-4ea1-ad8f-c6133570533d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:02.705868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abbd63-f759-4ea1-ad8f-c6133570533d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:02.707646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abbd63-f759-4ea1-ad8f-c6133570533d service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:02.719585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1208/2404] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:16:03.759870 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef448a-fc95-41ca-9e25-99958bcf7777 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:03.760464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef448a-fc95-41ca-9e25-99958bcf7777 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:03.760464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef448a-fc95-41ca-9e25-99958bcf7777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:03.816943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6eef448a-fc95-41ca-9e25-99958bcf7777 None None] MFA Rules not processed for user `be4c6ca1cde040c5b3cf0f84789ca4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:03.820338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6eef448a-fc95-41ca-9e25-99958bcf7777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:03.956924 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1197/2405] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:03.963213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abbd63-f759-4ea1-ad8f-c6133570533d service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:03.964396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-72abbd63-f759-4ea1-ad8f-c6133570533d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:04.064048 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abbd63-f759-4ea1-ad8f-c6133570533d service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:04.068150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686f03c-8bf6-4867-8808-15555c3e4cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:04.068919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686f03c-8bf6-4867-8808-15555c3e4cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:04.069221 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686f03c-8bf6-4867-8808-15555c3e4cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:04.069518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686f03c-8bf6-4867-8808-15555c3e4cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:04.079402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686f03c-8bf6-4867-8808-15555c3e4cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:04.080854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686f03c-8bf6-4867-8808-15555c3e4cb5 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:04.090245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1209/2406] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:16:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:16:05.461491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dfd17-1b6c-4fee-95e9-a44878500a4d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:05.462073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dfd17-1b6c-4fee-95e9-a44878500a4d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:05.462167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dfd17-1b6c-4fee-95e9-a44878500a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:05.481094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c13dfd17-1b6c-4fee-95e9-a44878500a4d None None] MFA Rules not processed for user `be4c6ca1cde040c5b3cf0f84789ca4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:05.482473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c13dfd17-1b6c-4fee-95e9-a44878500a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:05.494199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1198/2407] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:07.620663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b242d3-43eb-477d-9864-fadf5e0a119c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:07.621428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b242d3-43eb-477d-9864-fadf5e0a119c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:07.621428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b242d3-43eb-477d-9864-fadf5e0a119c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:07.639254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-90b242d3-43eb-477d-9864-fadf5e0a119c None None] MFA Rules not processed for user `d770c98d01ea4c9bb20b79dab4bfc0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:07.640483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-90b242d3-43eb-477d-9864-fadf5e0a119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:07.699473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1210/2408] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:16:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:15.475726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:17.692208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=80 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:24.128901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f85c21-a134-4f59-90d8-b770c521f02f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:24.129522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f85c21-a134-4f59-90d8-b770c521f02f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:24.129522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f85c21-a134-4f59-90d8-b770c521f02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:24.150985 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-92f85c21-a134-4f59-90d8-b770c521f02f None None] MFA Rules not processed for user `0a6708681b7549fcba86b5a7f3d0d0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:24.152782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-92f85c21-a134-4f59-90d8-b770c521f02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:24.211309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1199/2409] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:16:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:34.075526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e5fb1-7f07-4967-9caf-075a48d33e69 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:34.076642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e5fb1-7f07-4967-9caf-075a48d33e69 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:34.076836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e5fb1-7f07-4967-9caf-075a48d33e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:34.102562 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3d1e5fb1-7f07-4967-9caf-075a48d33e69 None None] MFA Rules not processed for user `81f7520d68b3473cbba90d8581afbfac`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:34.104169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3d1e5fb1-7f07-4967-9caf-075a48d33e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:34.163298 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1211/2410] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:16:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:34.204065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=25 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:36.268889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdb92e-1b1b-4f66-8955-dec293b1c3db None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:36.269650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdb92e-1b1b-4f66-8955-dec293b1c3db None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:36.269650 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdb92e-1b1b-4f66-8955-dec293b1c3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:36.290595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-08bdb92e-1b1b-4f66-8955-dec293b1c3db None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:36.291858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-08bdb92e-1b1b-4f66-8955-dec293b1c3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:36.301843 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1200/2411] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:36.327424 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e5fb1-7f07-4967-9caf-075a48d33e69 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:36.329141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3d1e5fb1-7f07-4967-9caf-075a48d33e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:36.440814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e5fb1-7f07-4967-9caf-075a48d33e69 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:36.446520 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779fb72-8ecc-470c-88fd-03c32756e7cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:36.447182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779fb72-8ecc-470c-88fd-03c32756e7cd service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:36.447464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779fb72-8ecc-470c-88fd-03c32756e7cd service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:36.447742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779fb72-8ecc-470c-88fd-03c32756e7cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:36.457641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779fb72-8ecc-470c-88fd-03c32756e7cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:36.459256 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779fb72-8ecc-470c-88fd-03c32756e7cd service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:36.470840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1212/2412] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:16:39.339342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc20d-6a1e-4853-8ef1-ef27bd656d74 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:39.339727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc20d-6a1e-4853-8ef1-ef27bd656d74 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:39.339727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc20d-6a1e-4853-8ef1-ef27bd656d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:39.372674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-58adc20d-6a1e-4853-8ef1-ef27bd656d74 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:39.374842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58adc20d-6a1e-4853-8ef1-ef27bd656d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:39.385291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1201/2413] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:39.413639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779fb72-8ecc-470c-88fd-03c32756e7cd service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:39.415469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0779fb72-8ecc-470c-88fd-03c32756e7cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:39.431579 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779fb72-8ecc-470c-88fd-03c32756e7cd service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:39.439807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a79d1b-c636-4135-b009-44bb467987e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:39.440747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a79d1b-c636-4135-b009-44bb467987e6 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:39.441176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a79d1b-c636-4135-b009-44bb467987e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:39.441716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a79d1b-c636-4135-b009-44bb467987e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:39.456790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a79d1b-c636-4135-b009-44bb467987e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:39.458784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a79d1b-c636-4135-b009-44bb467987e6 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:39.483540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1213/2414] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:16:43.621903 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13eab3-4733-417d-96e7-164acbd9ff1c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:43.622476 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13eab3-4733-417d-96e7-164acbd9ff1c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:43.622476 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13eab3-4733-417d-96e7-164acbd9ff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:43.642692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6f13eab3-4733-417d-96e7-164acbd9ff1c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:43.643891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6f13eab3-4733-417d-96e7-164acbd9ff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:43.653334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1202/2415] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:43.678334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a79d1b-c636-4135-b009-44bb467987e6 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:43.690469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a79d1b-c636-4135-b009-44bb467987e6 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:43.697858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61b572-953c-4b0f-bd66-1647b02a1bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:43.698488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61b572-953c-4b0f-bd66-1647b02a1bd9 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:43.698761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61b572-953c-4b0f-bd66-1647b02a1bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:43.699031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61b572-953c-4b0f-bd66-1647b02a1bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:43.708114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61b572-953c-4b0f-bd66-1647b02a1bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:43.709740 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61b572-953c-4b0f-bd66-1647b02a1bd9 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:43.719464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1214/2416] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:16:46.696967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fd04-6b36-40aa-ae4a-e4793941e883 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:46.697620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fd04-6b36-40aa-ae4a-e4793941e883 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:46.697620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fd04-6b36-40aa-ae4a-e4793941e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:46.719896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fc54fd04-6b36-40aa-ae4a-e4793941e883 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:46.721090 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fc54fd04-6b36-40aa-ae4a-e4793941e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:46.730383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1203/2417] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:46.761708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61b572-953c-4b0f-bd66-1647b02a1bd9 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:46.774092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61b572-953c-4b0f-bd66-1647b02a1bd9 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:46.780084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79260dea-aea5-438b-b4a3-53bc79bf13e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:46.780709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79260dea-aea5-438b-b4a3-53bc79bf13e4 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:46.781030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79260dea-aea5-438b-b4a3-53bc79bf13e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:46.781407 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79260dea-aea5-438b-b4a3-53bc79bf13e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:46.790954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79260dea-aea5-438b-b4a3-53bc79bf13e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:46.792654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79260dea-aea5-438b-b4a3-53bc79bf13e4 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:46.804102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1215/2418] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:16:50.914175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631358-0f9e-48f1-b3d1-19a4ef276421 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:50.914745 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631358-0f9e-48f1-b3d1-19a4ef276421 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:50.914745 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631358-0f9e-48f1-b3d1-19a4ef276421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:50.935805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f5631358-0f9e-48f1-b3d1-19a4ef276421 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:50.937197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f5631358-0f9e-48f1-b3d1-19a4ef276421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:50.946958 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1204/2419] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:50.969464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79260dea-aea5-438b-b4a3-53bc79bf13e4 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:50.981250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79260dea-aea5-438b-b4a3-53bc79bf13e4 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:50.988486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b4dc2-5ded-4e65-9a8b-6958c1d7b1b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:50.989146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b4dc2-5ded-4e65-9a8b-6958c1d7b1b3 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:50.989526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b4dc2-5ded-4e65-9a8b-6958c1d7b1b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:50.989810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b4dc2-5ded-4e65-9a8b-6958c1d7b1b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:50.998914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b4dc2-5ded-4e65-9a8b-6958c1d7b1b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:51.000689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b4dc2-5ded-4e65-9a8b-6958c1d7b1b3 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:51.011909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1216/2420] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:16:54.097699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11ca46-8ad8-49ec-98fc-767d4b0fe08d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:54.098238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11ca46-8ad8-49ec-98fc-767d4b0fe08d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:54.098238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11ca46-8ad8-49ec-98fc-767d4b0fe08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:54.117382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6a11ca46-8ad8-49ec-98fc-767d4b0fe08d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:16:54.118578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6a11ca46-8ad8-49ec-98fc-767d4b0fe08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:16:54.127339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1205/2421] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:16:54.151249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b4dc2-5ded-4e65-9a8b-6958c1d7b1b3 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:16:54.168198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b4dc2-5ded-4e65-9a8b-6958c1d7b1b3 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:16:54.181608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b9c9e-f6bd-4021-95e2-08e2cf0027c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:16:54.182272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b9c9e-f6bd-4021-95e2-08e2cf0027c2 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:16:54.182552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b9c9e-f6bd-4021-95e2-08e2cf0027c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:16:54.182791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b9c9e-f6bd-4021-95e2-08e2cf0027c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:16:54.192851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b9c9e-f6bd-4021-95e2-08e2cf0027c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:16:54.194468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b9c9e-f6bd-4021-95e2-08e2cf0027c2 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:16:54.205425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1217/2422] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:04.111701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=18 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:04.199927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:09.377599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508050b-43e7-4dbc-b1d5-e7480e4b1f48 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:09.378167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508050b-43e7-4dbc-b1d5-e7480e4b1f48 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:09.378167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508050b-43e7-4dbc-b1d5-e7480e4b1f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:09.398056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2508050b-43e7-4dbc-b1d5-e7480e4b1f48 None None] MFA Rules not processed for user `be4c6ca1cde040c5b3cf0f84789ca4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:09.399254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2508050b-43e7-4dbc-b1d5-e7480e4b1f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:09.408125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1206/2423] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:09.798061 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee72f0-38e8-44d8-a1a0-76e5d79771af None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:09.798569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee72f0-38e8-44d8-a1a0-76e5d79771af None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:09.798682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee72f0-38e8-44d8-a1a0-76e5d79771af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:09.817324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6bee72f0-38e8-44d8-a1a0-76e5d79771af None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:09.818536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6bee72f0-38e8-44d8-a1a0-76e5d79771af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:09.877419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1218/2424] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 17 15:17:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:09.927385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508050b-43e7-4dbc-b1d5-e7480e4b1f48 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:09.928854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2508050b-43e7-4dbc-b1d5-e7480e4b1f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:10.021342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508050b-43e7-4dbc-b1d5-e7480e4b1f48 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:10.025874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c133-bfab-4256-87d8-30bf1be7d29d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:10.026643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c133-bfab-4256-87d8-30bf1be7d29d service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:10.027011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c133-bfab-4256-87d8-30bf1be7d29d service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:10.027348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c133-bfab-4256-87d8-30bf1be7d29d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:10.036775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13c133-bfab-4256-87d8-30bf1be7d29d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:10.038515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13c133-bfab-4256-87d8-30bf1be7d29d service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:10.056397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1207/2425] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:17:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 15:17:18.387606 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee72f0-38e8-44d8-a1a0-76e5d79771af None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:18.389241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6bee72f0-38e8-44d8-a1a0-76e5d79771af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:18.408633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee72f0-38e8-44d8-a1a0-76e5d79771af None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:18.414314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:18.415628 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:18.416183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:18.416614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] PATH_INFO: `/v3/users/e7f85468275442b48f2396aa56f7b5dd` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:18.429292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f85468275442b48f2396aa56f7b5dd)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:18.431549 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:18.490899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f85468275442b48f2396aa56f7b5dd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:18.498929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f85468275442b48f2396aa56f7b5dd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:18.499983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f85468275442b48f2396aa56f7b5dd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:18.512740 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f85468275442b48f2396aa56f7b5dd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:18.513789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f85468275442b48f2396aa56f7b5dd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:18.544156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1219/2426] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:17:18 2022] DELETE /identity/v3/users/e7f85468275442b48f2396aa56f7b5dd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:18.907012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c133-bfab-4256-87d8-30bf1be7d29d service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:18.925401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c133-bfab-4256-87d8-30bf1be7d29d service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:18.993180 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:18.994230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:18.994495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:18.994768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] PATH_INFO: `/v3/projects/1b2b7a122ba0412197304bb4e4d97d70` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:18.996026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2b7a122ba0412197304bb4e4d97d70)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:18.998000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:19.047229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2b7a122ba0412197304bb4e4d97d70', 'request_id': 'req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.056922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2b7a122ba0412197304bb4e4d97d70', 'request_id': 'req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.065666 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2b7a122ba0412197304bb4e4d97d70', 'request_id': 'req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.077633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] The token cache is being invalidate because project 1b2b7a122ba0412197304bb4e4d97d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:17:19.078138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.078829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.080619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1208/2427] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:17:18 2022] DELETE /identity/v3/projects/1b2b7a122ba0412197304bb4e4d97d70 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:19.085699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:19.087591 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:19.101621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f8bbf-3676-456e-86bd-a73cb8d3e4f9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:19.160290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:19.161172 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:19.161482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:19.161734 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] PATH_INFO: `/v3/users/1781ce47229f4b138e5296f666260119` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:19.163031 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1781ce47229f4b138e5296f666260119)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:19.164939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:19.187000 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:19.222349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1781ce47229f4b138e5296f666260119'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.230113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1781ce47229f4b138e5296f666260119'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.230819 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1781ce47229f4b138e5296f666260119'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.240165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1781ce47229f4b138e5296f666260119'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.240913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c5b0c12-3759-4c4f-9abc-dfd8f9bce35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1781ce47229f4b138e5296f666260119'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.262873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1220/2428] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:17:19 2022] DELETE /identity/v3/users/1781ce47229f4b138e5296f666260119 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:19.451743 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:19.453870 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:19.462281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:19.469121 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d9c1b-60ef-4f0c-b0e4-1b29f5a40d81 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:19.550012 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:19.550782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:19.551120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:19.552170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] PATH_INFO: `/v3/projects/1ded13f6328646499f5c2d35c76f9619` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:19.552886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ded13f6328646499f5c2d35c76f9619)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:19.555118 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:19.614919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ded13f6328646499f5c2d35c76f9619', 'request_id': 'req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.622434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ded13f6328646499f5c2d35c76f9619', 'request_id': 'req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.631431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ded13f6328646499f5c2d35c76f9619', 'request_id': 'req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.642788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] The token cache is being invalidate because project 1ded13f6328646499f5c2d35c76f9619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:17:19.643074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.643693 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0d601e7f-bf0e-47ae-82a4-71f85d1bbf05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:19.645279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1209/2429] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:17:19 2022] DELETE /identity/v3/projects/1ded13f6328646499f5c2d35c76f9619 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:24.565540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45144-a52f-4f1e-863d-12289e705e5e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:24.566068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45144-a52f-4f1e-863d-12289e705e5e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:24.566068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45144-a52f-4f1e-863d-12289e705e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:24.584507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a6b45144-a52f-4f1e-863d-12289e705e5e None None] MFA Rules not processed for user `d770c98d01ea4c9bb20b79dab4bfc0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:24.585736 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a6b45144-a52f-4f1e-863d-12289e705e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:24.644592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1221/2430] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:29.639128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:30.713972 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541f7a2-1fa5-410d-9f06-98298a01c79d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:30.714636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541f7a2-1fa5-410d-9f06-98298a01c79d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:30.714636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541f7a2-1fa5-410d-9f06-98298a01c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:30.734845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b541f7a2-1fa5-410d-9f06-98298a01c79d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:30.736096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b541f7a2-1fa5-410d-9f06-98298a01c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:30.808912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1210/2431] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:30.833450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b45144-a52f-4f1e-863d-12289e705e5e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:30.835149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a6b45144-a52f-4f1e-863d-12289e705e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:30.912690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b45144-a52f-4f1e-863d-12289e705e5e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:30.922464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ea6eb-c533-4277-8720-611f9dd9a51b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:30.923120 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ea6eb-c533-4277-8720-611f9dd9a51b service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:30.923397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ea6eb-c533-4277-8720-611f9dd9a51b service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:30.923662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ea6eb-c533-4277-8720-611f9dd9a51b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:30.932291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ea6eb-c533-4277-8720-611f9dd9a51b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:30.933937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ea6eb-c533-4277-8720-611f9dd9a51b service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:30.944897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1222/2432] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:32.159577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541f7a2-1fa5-410d-9f06-98298a01c79d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:32.161246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b541f7a2-1fa5-410d-9f06-98298a01c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:32.226183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541f7a2-1fa5-410d-9f06-98298a01c79d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:32.230391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f700ea8-0f04-495e-9f59-ded27c9fcf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:32.231039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700ea8-0f04-495e-9f59-ded27c9fcf65 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:32.231320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700ea8-0f04-495e-9f59-ded27c9fcf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:32.231597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700ea8-0f04-495e-9f59-ded27c9fcf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:32.233431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0f700ea8-0f04-495e-9f59-ded27c9fcf65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:32.248661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f700ea8-0f04-495e-9f59-ded27c9fcf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:32.250800 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f700ea8-0f04-495e-9f59-ded27c9fcf65 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:32.262053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1211/2433] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:33.754402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ea6eb-c533-4277-8720-611f9dd9a51b service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:33.764446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ea6eb-c533-4277-8720-611f9dd9a51b service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:33.773992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069b243-9b51-44d8-bb12-8dfcff7950b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:33.774698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b243-9b51-44d8-bb12-8dfcff7950b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:33.775154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b243-9b51-44d8-bb12-8dfcff7950b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:33.775644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b243-9b51-44d8-bb12-8dfcff7950b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:33.777841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1069b243-9b51-44d8-bb12-8dfcff7950b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:33.795522 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b243-9b51-44d8-bb12-8dfcff7950b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:33.797047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b243-9b51-44d8-bb12-8dfcff7950b4 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:33.809412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1223/2434] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:36.092747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7fbd-4ef0-4cd4-942a-df3d988c8b3d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:36.093377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7fbd-4ef0-4cd4-942a-df3d988c8b3d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:36.093477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7fbd-4ef0-4cd4-942a-df3d988c8b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:36.118072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-508d7fbd-4ef0-4cd4-942a-df3d988c8b3d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:36.119311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-508d7fbd-4ef0-4cd4-942a-df3d988c8b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:36.129993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1212/2435] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:36.152165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069b243-9b51-44d8-bb12-8dfcff7950b4 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:36.164519 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069b243-9b51-44d8-bb12-8dfcff7950b4 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:36.171199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d352291-35be-4492-aa0d-67505d29dc90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:36.171873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d352291-35be-4492-aa0d-67505d29dc90 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:36.172157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d352291-35be-4492-aa0d-67505d29dc90 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:36.172434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d352291-35be-4492-aa0d-67505d29dc90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:36.181565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d352291-35be-4492-aa0d-67505d29dc90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:36.183257 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d352291-35be-4492-aa0d-67505d29dc90 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:36.188365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:36.193737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1224/2436] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:37.367153 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7fbd-4ef0-4cd4-942a-df3d988c8b3d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:37.368676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-508d7fbd-4ef0-4cd4-942a-df3d988c8b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:37.381935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7fbd-4ef0-4cd4-942a-df3d988c8b3d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:37.386429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f9e38-1467-4b0b-b620-531cdd06e74a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:37.387069 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f9e38-1467-4b0b-b620-531cdd06e74a service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:37.387346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f9e38-1467-4b0b-b620-531cdd06e74a service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:37.387620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f9e38-1467-4b0b-b620-531cdd06e74a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:37.389477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0d9f9e38-1467-4b0b-b620-531cdd06e74a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:37.402151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f9e38-1467-4b0b-b620-531cdd06e74a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:37.403741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f9e38-1467-4b0b-b620-531cdd06e74a service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:37.414774 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1213/2437] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:40.220082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847f76-aa85-4bfb-a7e0-1f5047ff70ab None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:40.220680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847f76-aa85-4bfb-a7e0-1f5047ff70ab None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:40.220680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847f76-aa85-4bfb-a7e0-1f5047ff70ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:40.240509 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-df847f76-aa85-4bfb-a7e0-1f5047ff70ab None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:40.241876 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-df847f76-aa85-4bfb-a7e0-1f5047ff70ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:40.250055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1225/2438] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:40.293145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f9e38-1467-4b0b-b620-531cdd06e74a service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:40.294808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0d9f9e38-1467-4b0b-b620-531cdd06e74a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:40.316128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f9e38-1467-4b0b-b620-531cdd06e74a service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:40.332391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e3b82-d611-4a1f-9faf-2e4741ecf4c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:40.333073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e3b82-d611-4a1f-9faf-2e4741ecf4c3 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:40.333407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e3b82-d611-4a1f-9faf-2e4741ecf4c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:40.333797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e3b82-d611-4a1f-9faf-2e4741ecf4c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:40.343212 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e3b82-d611-4a1f-9faf-2e4741ecf4c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:40.344817 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e3b82-d611-4a1f-9faf-2e4741ecf4c3 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:40.356277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1214/2439] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:41.216646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df847f76-aa85-4bfb-a7e0-1f5047ff70ab None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:41.218173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-df847f76-aa85-4bfb-a7e0-1f5047ff70ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:41.236782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df847f76-aa85-4bfb-a7e0-1f5047ff70ab None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:41.243122 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:41.244008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:41.244290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:41.244563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] PATH_INFO: `/v3/users/0a6708681b7549fcba86b5a7f3d0d0ae` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:41.245871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6708681b7549fcba86b5a7f3d0d0ae)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:41.247796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:41.308592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6708681b7549fcba86b5a7f3d0d0ae'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:41.316166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6708681b7549fcba86b5a7f3d0d0ae'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:41.316858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6708681b7549fcba86b5a7f3d0d0ae'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:41.327274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6708681b7549fcba86b5a7f3d0d0ae'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:41.328037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8a0bb153-3d3e-460c-a809-4da061c6ba27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6708681b7549fcba86b5a7f3d0d0ae'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:41.347505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1226/2440] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:17:41 2022] DELETE /identity/v3/users/0a6708681b7549fcba86b5a7f3d0d0ae => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:41.560879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e3b82-d611-4a1f-9faf-2e4741ecf4c3 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:41.571521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e3b82-d611-4a1f-9faf-2e4741ecf4c3 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:41.639929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:41.640791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:41.641068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:41.641376 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] PATH_INFO: `/v3/projects/0feab24ff4814097a85bbe1f2d634a42` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:41.642582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0feab24ff4814097a85bbe1f2d634a42)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:41.644674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:41.655695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:41.696545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0feab24ff4814097a85bbe1f2d634a42', 'request_id': 'req-4beaf20f-5300-4296-bb49-0f9208236ab9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:41.703114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0feab24ff4814097a85bbe1f2d634a42', 'request_id': 'req-4beaf20f-5300-4296-bb49-0f9208236ab9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:41.712614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0feab24ff4814097a85bbe1f2d634a42', 'request_id': 'req-4beaf20f-5300-4296-bb49-0f9208236ab9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:41.723456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] The token cache is being invalidate because project 0feab24ff4814097a85bbe1f2d634a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:17:41.723739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:41.724414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4beaf20f-5300-4296-bb49-0f9208236ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:41.726073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1215/2441] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:17:41 2022] DELETE /identity/v3/projects/0feab24ff4814097a85bbe1f2d634a42 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:41.731064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0ec7f-2766-4d39-9f5d-e965e579f124 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:41.731350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0ec7f-2766-4d39-9f5d-e965e579f124 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:41.731634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0ec7f-2766-4d39-9f5d-e965e579f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:41.750477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f9d0ec7f-2766-4d39-9f5d-e965e579f124 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:41.751678 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f9d0ec7f-2766-4d39-9f5d-e965e579f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:41.826468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1227/2442] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:41.835247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8885d4-95d5-414a-8bb2-64709558e3d3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:41.835545 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8885d4-95d5-414a-8bb2-64709558e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:41.835826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8885d4-95d5-414a-8bb2-64709558e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:41.857503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6c8885d4-95d5-414a-8bb2-64709558e3d3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:41.858787 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6c8885d4-95d5-414a-8bb2-64709558e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:41.872221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1216/2443] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:41.873539 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0ec7f-2766-4d39-9f5d-e965e579f124 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:41.890482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0ec7f-2766-4d39-9f5d-e965e579f124 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:41.896808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba5d53-41c1-49d1-bf07-55eab0fabff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:41.897690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba5d53-41c1-49d1-bf07-55eab0fabff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:41.897970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba5d53-41c1-49d1-bf07-55eab0fabff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:41.898293 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba5d53-41c1-49d1-bf07-55eab0fabff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:41.899032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba5d53-41c1-49d1-bf07-55eab0fabff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:17:41.899385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba5d53-41c1-49d1-bf07-55eab0fabff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:41.900999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba5d53-41c1-49d1-bf07-55eab0fabff4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:41.927594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1228/2444] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:17:41.934124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8885d4-95d5-414a-8bb2-64709558e3d3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:41.945821 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8885d4-95d5-414a-8bb2-64709558e3d3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:41.952846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26f8bd-a4bd-4c04-8264-d113bfcfdd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:41.953806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26f8bd-a4bd-4c04-8264-d113bfcfdd31 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:41.954312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26f8bd-a4bd-4c04-8264-d113bfcfdd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:41.954784 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26f8bd-a4bd-4c04-8264-d113bfcfdd31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:41.956027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26f8bd-a4bd-4c04-8264-d113bfcfdd31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:41.958260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26f8bd-a4bd-4c04-8264-d113bfcfdd31 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:41.989667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1217/2445] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:17:41 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:17:41.993674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba5d53-41c1-49d1-bf07-55eab0fabff4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.005094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba5d53-41c1-49d1-bf07-55eab0fabff4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:42.057137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:42.070808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf357684-af2f-41bd-96ef-c75edf16bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:42.071687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357684-af2f-41bd-96ef-c75edf16bac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.072406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357684-af2f-41bd-96ef-c75edf16bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.072898 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357684-af2f-41bd-96ef-c75edf16bac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.073691 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf357684-af2f-41bd-96ef-c75edf16bac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:42.077011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf357684-af2f-41bd-96ef-c75edf16bac9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:42.105395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1229/2446] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:17:41 2022] POST /identity/v3/users => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:17:42.106636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26f8bd-a4bd-4c04-8264-d113bfcfdd31 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.117625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26f8bd-a4bd-4c04-8264-d113bfcfdd31 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:42.122775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7f5a0-a4a6-46be-a686-e4a1152fa1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:42.123461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7f5a0-a4a6-46be-a686-e4a1152fa1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.123720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7f5a0-a4a6-46be-a686-e4a1152fa1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.123992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7f5a0-a4a6-46be-a686-e4a1152fa1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.124717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7f5a0-a4a6-46be-a686-e4a1152fa1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:42.126377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7f5a0-a4a6-46be-a686-e4a1152fa1a7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:42.138600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1218/2447] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:17:42.143296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf357684-af2f-41bd-96ef-c75edf16bac9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.153822 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf357684-af2f-41bd-96ef-c75edf16bac9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:42.158947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd32e1a-d2a1-433d-aa17-c3e7426aac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:42.159687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd32e1a-d2a1-433d-aa17-c3e7426aac1f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.159967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd32e1a-d2a1-433d-aa17-c3e7426aac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.160244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd32e1a-d2a1-433d-aa17-c3e7426aac1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.161003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd32e1a-d2a1-433d-aa17-c3e7426aac1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:42.162642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd32e1a-d2a1-433d-aa17-c3e7426aac1f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:42.173450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1230/2448] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:17:42.178287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7f5a0-a4a6-46be-a686-e4a1152fa1a7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.189042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7f5a0-a4a6-46be-a686-e4a1152fa1a7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:42.194459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35271f3d-a7a3-4dc4-a2f2-c132551e7051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:42.195504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35271f3d-a7a3-4dc4-a2f2-c132551e7051 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.195781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35271f3d-a7a3-4dc4-a2f2-c132551e7051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.196052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35271f3d-a7a3-4dc4-a2f2-c132551e7051 admin admin] PATH_INFO: `/v3/projects/12e29703fef74dca93125eda8241a65e/users/0f87792114c54bd4b97964763c6db0aa/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.214577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35271f3d-a7a3-4dc4-a2f2-c132551e7051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e29703fef74dca93125eda8241a65e, user_id=0f87792114c54bd4b97964763c6db0aa, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:42.217570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35271f3d-a7a3-4dc4-a2f2-c132551e7051 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:42.232151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1219/2449] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:17:42 2022] PUT /identity/v3/projects/12e29703fef74dca93125eda8241a65e/users/0f87792114c54bd4b97964763c6db0aa/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:42.242955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d15a-c01a-4f50-972d-a73d53e40783 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.243359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d15a-c01a-4f50-972d-a73d53e40783 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.243512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d15a-c01a-4f50-972d-a73d53e40783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.273775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ef98d15a-c01a-4f50-972d-a73d53e40783 None None] MFA Rules not processed for user `0f87792114c54bd4b97964763c6db0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:42.274971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ef98d15a-c01a-4f50-972d-a73d53e40783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:42.353071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1231/2450] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:42.355176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35271f3d-a7a3-4dc4-a2f2-c132551e7051 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.424141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35271f3d-a7a3-4dc4-a2f2-c132551e7051 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:42.429521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9220-db15-41d1-8f4f-2f4cdd761635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:42.430304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9220-db15-41d1-8f4f-2f4cdd761635 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.430570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9220-db15-41d1-8f4f-2f4cdd761635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.430845 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9220-db15-41d1-8f4f-2f4cdd761635 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.431579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c9220-db15-41d1-8f4f-2f4cdd761635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:42.433585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c9220-db15-41d1-8f4f-2f4cdd761635 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:42.465387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1220/2451] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:17:42 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:17:42.468755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d15a-c01a-4f50-972d-a73d53e40783 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.479906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d15a-c01a-4f50-972d-a73d53e40783 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:42.537421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778c567-ccb1-4811-a6df-0bcdbaf37228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:42.538137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778c567-ccb1-4811-a6df-0bcdbaf37228 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.538415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778c567-ccb1-4811-a6df-0bcdbaf37228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.538745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778c567-ccb1-4811-a6df-0bcdbaf37228 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.539560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778c567-ccb1-4811-a6df-0bcdbaf37228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:42.541659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778c567-ccb1-4811-a6df-0bcdbaf37228 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:42.568288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1232/2452] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:17:42 2022] POST /identity/v3/users => generated 309 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:17:42.572619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9220-db15-41d1-8f4f-2f4cdd761635 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.584200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9220-db15-41d1-8f4f-2f4cdd761635 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:42.588824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce898c9-fa02-4a54-a212-bce9e2b58b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:42.589528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce898c9-fa02-4a54-a212-bce9e2b58b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.589811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce898c9-fa02-4a54-a212-bce9e2b58b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.590087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce898c9-fa02-4a54-a212-bce9e2b58b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.590944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce898c9-fa02-4a54-a212-bce9e2b58b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:42.592556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce898c9-fa02-4a54-a212-bce9e2b58b60 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:42.604266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1221/2453] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:17:42.608555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778c567-ccb1-4811-a6df-0bcdbaf37228 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.622206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778c567-ccb1-4811-a6df-0bcdbaf37228 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:42.627710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103570c-d248-4ceb-b4e1-aac799c0d174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:42.628664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103570c-d248-4ceb-b4e1-aac799c0d174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.628812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103570c-d248-4ceb-b4e1-aac799c0d174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.629090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103570c-d248-4ceb-b4e1-aac799c0d174 admin admin] PATH_INFO: `/v3/projects/abfcb022eea64abbbfd640bac78520a7/users/24924f2013224c66bc06a9e8ed7a8964/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.656144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103570c-d248-4ceb-b4e1-aac799c0d174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfcb022eea64abbbfd640bac78520a7, user_id=24924f2013224c66bc06a9e8ed7a8964, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:42.659164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103570c-d248-4ceb-b4e1-aac799c0d174 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:42.674167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1233/2454] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:17:42 2022] PUT /identity/v3/projects/abfcb022eea64abbbfd640bac78520a7/users/24924f2013224c66bc06a9e8ed7a8964/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:17:42.679073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce898c9-fa02-4a54-a212-bce9e2b58b60 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.689957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce898c9-fa02-4a54-a212-bce9e2b58b60 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:42.698317 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:42.751883 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0c8fc-04ed-44d7-93af-969bc452d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:42.752567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0c8fc-04ed-44d7-93af-969bc452d140 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.752847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0c8fc-04ed-44d7-93af-969bc452d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.753131 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0c8fc-04ed-44d7-93af-969bc452d140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.753890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0c8fc-04ed-44d7-93af-969bc452d140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:42.755513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0c8fc-04ed-44d7-93af-969bc452d140 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:42.766242 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1222/2455] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:17:42.770666 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103570c-d248-4ceb-b4e1-aac799c0d174 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.781550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103570c-d248-4ceb-b4e1-aac799c0d174 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:42.787593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01608974-d38b-4222-8fa3-4bf531899cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:42.788599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01608974-d38b-4222-8fa3-4bf531899cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.788854 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01608974-d38b-4222-8fa3-4bf531899cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.789154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01608974-d38b-4222-8fa3-4bf531899cd0 admin admin] PATH_INFO: `/v3/projects/abfcb022eea64abbbfd640bac78520a7/users/24924f2013224c66bc06a9e8ed7a8964/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.791468 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01608974-d38b-4222-8fa3-4bf531899cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfcb022eea64abbbfd640bac78520a7, user_id=24924f2013224c66bc06a9e8ed7a8964, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:42.794229 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01608974-d38b-4222-8fa3-4bf531899cd0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:42.807004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1234/2456] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:17:42 2022] PUT /identity/v3/projects/abfcb022eea64abbbfd640bac78520a7/users/24924f2013224c66bc06a9e8ed7a8964/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:42.819194 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742aa1d-723c-4584-aae8-51b14f2c9697 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:42.819484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742aa1d-723c-4584-aae8-51b14f2c9697 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:42.819767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742aa1d-723c-4584-aae8-51b14f2c9697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:42.849112 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5742aa1d-723c-4584-aae8-51b14f2c9697 None None] MFA Rules not processed for user `24924f2013224c66bc06a9e8ed7a8964`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:42.850360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5742aa1d-723c-4584-aae8-51b14f2c9697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:42.926445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1223/2457] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:42.937697 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01608974-d38b-4222-8fa3-4bf531899cd0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:42.939626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-01608974-d38b-4222-8fa3-4bf531899cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:42.955472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:43.000746 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01608974-d38b-4222-8fa3-4bf531899cd0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:43.005308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae544abc-6894-408f-ad34-901723c2e79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:43.005887 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae544abc-6894-408f-ad34-901723c2e79c service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:43.006174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae544abc-6894-408f-ad34-901723c2e79c service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:43.006472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae544abc-6894-408f-ad34-901723c2e79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:43.016964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae544abc-6894-408f-ad34-901723c2e79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:43.025780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae544abc-6894-408f-ad34-901723c2e79c service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:43.037576 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1235/2458] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:42 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:43.198865 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742aa1d-723c-4584-aae8-51b14f2c9697 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:43.264973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742aa1d-723c-4584-aae8-51b14f2c9697 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:43.269768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:43.270657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:43.270932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:43.271207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] PATH_INFO: `/v3/users/0f87792114c54bd4b97964763c6db0aa` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:43.272559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f87792114c54bd4b97964763c6db0aa)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:43.274416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:43.323345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:43.334552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f87792114c54bd4b97964763c6db0aa'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:43.342201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f87792114c54bd4b97964763c6db0aa'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:43.342909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f87792114c54bd4b97964763c6db0aa'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:43.354574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f87792114c54bd4b97964763c6db0aa'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:43.369370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-73991476-c9b9-4b26-bdc4-044f11c24672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f87792114c54bd4b97964763c6db0aa'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:43.375597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1224/2459] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:17:43 2022] DELETE /identity/v3/users/0f87792114c54bd4b97964763c6db0aa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:43.381552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1f91-1b85-4925-83ea-a70f34f4fb6e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:43.381552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1f91-1b85-4925-83ea-a70f34f4fb6e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:43.381552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1f91-1b85-4925-83ea-a70f34f4fb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:43.399284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dc9d1f91-1b85-4925-83ea-a70f34f4fb6e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:43.400496 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dc9d1f91-1b85-4925-83ea-a70f34f4fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:43.413719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b78a0-0b57-486a-9a22-be11cd24e7c1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:43.414016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b78a0-0b57-486a-9a22-be11cd24e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:43.414299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b78a0-0b57-486a-9a22-be11cd24e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:43.435614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-159b78a0-0b57-486a-9a22-be11cd24e7c1 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:43.436653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-159b78a0-0b57-486a-9a22-be11cd24e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:43.469681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1236/2460] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:17:43.481780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d1f91-1b85-4925-83ea-a70f34f4fb6e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:43.484063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dc9d1f91-1b85-4925-83ea-a70f34f4fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:43.506358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1225/2461] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:17:43.528064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b78a0-0b57-486a-9a22-be11cd24e7c1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:43.529396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-159b78a0-0b57-486a-9a22-be11cd24e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:43.544655 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d1f91-1b85-4925-83ea-a70f34f4fb6e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:43.548470 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f019a-0a18-45a0-b495-49f65a044f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:43.549234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f019a-0a18-45a0-b495-49f65a044f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:43.549942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f019a-0a18-45a0-b495-49f65a044f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:43.550225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f019a-0a18-45a0-b495-49f65a044f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:43.559815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f019a-0a18-45a0-b495-49f65a044f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:43.561560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f019a-0a18-45a0-b495-49f65a044f4a service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:43.571339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1237/2462] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:43.603446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b78a0-0b57-486a-9a22-be11cd24e7c1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:43.609316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d7111-aa2d-440d-81f7-aa023b15c396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:43.609978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d7111-aa2d-440d-81f7-aa023b15c396 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:43.610310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d7111-aa2d-440d-81f7-aa023b15c396 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:43.610552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d7111-aa2d-440d-81f7-aa023b15c396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:43.620512 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d7111-aa2d-440d-81f7-aa023b15c396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:43.622169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d7111-aa2d-440d-81f7-aa023b15c396 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:43.632430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1226/2463] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:17:43.862247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f019a-0a18-45a0-b495-49f65a044f4a service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:43.863530 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-141f019a-0a18-45a0-b495-49f65a044f4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:43.886694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f019a-0a18-45a0-b495-49f65a044f4a service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:43.901870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:43.903114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:43.903450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:43.903840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] PATH_INFO: `/v3/projects/12e29703fef74dca93125eda8241a65e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:43.905225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e29703fef74dca93125eda8241a65e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:43.907283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:43.968311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e29703fef74dca93125eda8241a65e', 'request_id': 'req-a5ddd8cb-6044-4496-84db-72cc75b991bd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:43.975929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e29703fef74dca93125eda8241a65e', 'request_id': 'req-a5ddd8cb-6044-4496-84db-72cc75b991bd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:43.977927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:43.985863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e29703fef74dca93125eda8241a65e', 'request_id': 'req-a5ddd8cb-6044-4496-84db-72cc75b991bd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:43.996561 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] The token cache is being invalidate because project 12e29703fef74dca93125eda8241a65e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:17:43.996846 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:43.997525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:43.999154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1238/2464] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:17:43 2022] DELETE /identity/v3/projects/12e29703fef74dca93125eda8241a65e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:44.003467 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d7111-aa2d-440d-81f7-aa023b15c396 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:44.013698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d7111-aa2d-440d-81f7-aa023b15c396 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:44.052747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:44.080588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05466356-399b-467b-8322-3629c356a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:44.081494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05466356-399b-467b-8322-3629c356a463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:44.081783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05466356-399b-467b-8322-3629c356a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:44.082058 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05466356-399b-467b-8322-3629c356a463 admin admin] PATH_INFO: `/v3/users/24924f2013224c66bc06a9e8ed7a8964` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:44.083357 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05466356-399b-467b-8322-3629c356a463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24924f2013224c66bc06a9e8ed7a8964)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:44.085324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05466356-399b-467b-8322-3629c356a463 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:44.135487 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05466356-399b-467b-8322-3629c356a463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24924f2013224c66bc06a9e8ed7a8964'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:44.142377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05466356-399b-467b-8322-3629c356a463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24924f2013224c66bc06a9e8ed7a8964'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:44.143031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05466356-399b-467b-8322-3629c356a463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24924f2013224c66bc06a9e8ed7a8964'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:44.151618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05466356-399b-467b-8322-3629c356a463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24924f2013224c66bc06a9e8ed7a8964'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:44.164300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05466356-399b-467b-8322-3629c356a463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24924f2013224c66bc06a9e8ed7a8964'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:44.170356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1227/2465] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:17:44 2022] DELETE /identity/v3/users/24924f2013224c66bc06a9e8ed7a8964 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:44.178550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:44.180151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:44.262554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd8cb-6044-4496-84db-72cc75b991bd admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:44.333053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71f8bb-3202-4f89-a511-0cbeab54f6d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:44.333758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71f8bb-3202-4f89-a511-0cbeab54f6d2 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:44.334043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71f8bb-3202-4f89-a511-0cbeab54f6d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:44.334318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71f8bb-3202-4f89-a511-0cbeab54f6d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:44.336081 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ba71f8bb-3202-4f89-a511-0cbeab54f6d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:44.405799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71f8bb-3202-4f89-a511-0cbeab54f6d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:44.407722 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71f8bb-3202-4f89-a511-0cbeab54f6d2 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:44.419650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1239/2466] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:44.473856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05466356-399b-467b-8322-3629c356a463 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:44.475353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-05466356-399b-467b-8322-3629c356a463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:44.558351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05466356-399b-467b-8322-3629c356a463 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:44.563285 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:44.564193 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:44.564489 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:44.564792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] PATH_INFO: `/v3/projects/abfcb022eea64abbbfd640bac78520a7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:44.566037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abfcb022eea64abbbfd640bac78520a7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:44.567967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:44.617246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abfcb022eea64abbbfd640bac78520a7', 'request_id': 'req-8b14fa26-9c0c-462e-956a-01fc0a997005'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:44.623863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abfcb022eea64abbbfd640bac78520a7', 'request_id': 'req-8b14fa26-9c0c-462e-956a-01fc0a997005'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:44.627540 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:44.633728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abfcb022eea64abbbfd640bac78520a7', 'request_id': 'req-8b14fa26-9c0c-462e-956a-01fc0a997005'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:44.647485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] The token cache is being invalidate because project abfcb022eea64abbbfd640bac78520a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:17:44.648074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:44.648722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8b14fa26-9c0c-462e-956a-01fc0a997005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:44.650303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1228/2467] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:17:44 2022] DELETE /identity/v3/projects/abfcb022eea64abbbfd640bac78520a7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:44.655330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f065161-6379-4cdd-8547-e49228e4b3dd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:44.655618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f065161-6379-4cdd-8547-e49228e4b3dd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:44.655897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f065161-6379-4cdd-8547-e49228e4b3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:44.674581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1f065161-6379-4cdd-8547-e49228e4b3dd None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:44.676148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1f065161-6379-4cdd-8547-e49228e4b3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:44.689014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:44.741878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1240/2468] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:44.749747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c6bf8-e63d-45aa-8cc8-b5b4610f1955 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:44.750039 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c6bf8-e63d-45aa-8cc8-b5b4610f1955 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:44.750336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c6bf8-e63d-45aa-8cc8-b5b4610f1955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:44.769170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f31c6bf8-e63d-45aa-8cc8-b5b4610f1955 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:44.770399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f31c6bf8-e63d-45aa-8cc8-b5b4610f1955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:44.778588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1229/2469] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:44.783208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f065161-6379-4cdd-8547-e49228e4b3dd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:44.794608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f065161-6379-4cdd-8547-e49228e4b3dd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:44.799514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2f3d-c1da-4edc-8a89-7ebc71bac4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:44.800284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2f3d-c1da-4edc-8a89-7ebc71bac4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:44.802163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2f3d-c1da-4edc-8a89-7ebc71bac4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:44.802163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2f3d-c1da-4edc-8a89-7ebc71bac4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:44.802163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d2f3d-c1da-4edc-8a89-7ebc71bac4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:17:44.802163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d2f3d-c1da-4edc-8a89-7ebc71bac4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:44.803505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d2f3d-c1da-4edc-8a89-7ebc71bac4a2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:44.816276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1241/2470] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:17:44.820875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c6bf8-e63d-45aa-8cc8-b5b4610f1955 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:44.830914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c6bf8-e63d-45aa-8cc8-b5b4610f1955 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:44.836187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d89c-d066-4cc7-ac18-f11d68a408c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:44.836801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d89c-d066-4cc7-ac18-f11d68a408c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:44.837087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d89c-d066-4cc7-ac18-f11d68a408c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:44.837395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d89c-d066-4cc7-ac18-f11d68a408c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:44.838098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d89c-d066-4cc7-ac18-f11d68a408c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:44.840034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d89c-d066-4cc7-ac18-f11d68a408c1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:44.871457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1230/2471] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:17:44 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:17:44.875858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2f3d-c1da-4edc-8a89-7ebc71bac4a2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:44.886334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2f3d-c1da-4edc-8a89-7ebc71bac4a2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:44.978432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6724af-08b6-4ae1-a57f-0a99d717b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:44.978432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6724af-08b6-4ae1-a57f-0a99d717b00e admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:44.978432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6724af-08b6-4ae1-a57f-0a99d717b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:44.978432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6724af-08b6-4ae1-a57f-0a99d717b00e admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:44.978921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6724af-08b6-4ae1-a57f-0a99d717b00e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:44.980461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6724af-08b6-4ae1-a57f-0a99d717b00e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:45.006845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1242/2472] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:17:44 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:17:45.010791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d89c-d066-4cc7-ac18-f11d68a408c1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:45.022070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d89c-d066-4cc7-ac18-f11d68a408c1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:45.027458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7402b-da97-4972-b77f-7491d3fd5e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:45.028137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7402b-da97-4972-b77f-7491d3fd5e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.028420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7402b-da97-4972-b77f-7491d3fd5e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.028717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7402b-da97-4972-b77f-7491d3fd5e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.029461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7402b-da97-4972-b77f-7491d3fd5e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:45.031079 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7402b-da97-4972-b77f-7491d3fd5e93 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:45.043647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1231/2473] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:17:45.047753 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6724af-08b6-4ae1-a57f-0a99d717b00e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:45.061843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6724af-08b6-4ae1-a57f-0a99d717b00e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:45.067568 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e9b4b-f753-4344-8800-b3b5aee4d809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:45.069186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e9b4b-f753-4344-8800-b3b5aee4d809 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.069683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e9b4b-f753-4344-8800-b3b5aee4d809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.070104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e9b4b-f753-4344-8800-b3b5aee4d809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.070898 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e9b4b-f753-4344-8800-b3b5aee4d809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:45.073124 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e9b4b-f753-4344-8800-b3b5aee4d809 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:45.090833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1243/2474] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:17:45.092324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7402b-da97-4972-b77f-7491d3fd5e93 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:45.104111 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7402b-da97-4972-b77f-7491d3fd5e93 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:45.109399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb64a5-be39-4359-a86c-0f415522083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:45.110359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb64a5-be39-4359-a86c-0f415522083c admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.110641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb64a5-be39-4359-a86c-0f415522083c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.110917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb64a5-be39-4359-a86c-0f415522083c admin admin] PATH_INFO: `/v3/projects/ef4a5e17051a46f5a3e9bfc3f9e3f472/users/dc43f90a98b44985ab6baabca6e9296f/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.126271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb64a5-be39-4359-a86c-0f415522083c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4a5e17051a46f5a3e9bfc3f9e3f472, user_id=dc43f90a98b44985ab6baabca6e9296f, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:45.129014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb64a5-be39-4359-a86c-0f415522083c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:45.144837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1232/2475] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:17:45 2022] PUT /identity/v3/projects/ef4a5e17051a46f5a3e9bfc3f9e3f472/users/dc43f90a98b44985ab6baabca6e9296f/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:45.155709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74051a3-0aa6-42dc-8e36-1bb775ae7730 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.156479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74051a3-0aa6-42dc-8e36-1bb775ae7730 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.156830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74051a3-0aa6-42dc-8e36-1bb775ae7730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.185065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f74051a3-0aa6-42dc-8e36-1bb775ae7730 None None] MFA Rules not processed for user `dc43f90a98b44985ab6baabca6e9296f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:45.186360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f74051a3-0aa6-42dc-8e36-1bb775ae7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:45.254866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1244/2476] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:45.259431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb64a5-be39-4359-a86c-0f415522083c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:45.324170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb64a5-be39-4359-a86c-0f415522083c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:45.329313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced213a-be6c-4c97-95d8-7a118922711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:45.329962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced213a-be6c-4c97-95d8-7a118922711a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.330273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced213a-be6c-4c97-95d8-7a118922711a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.330630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced213a-be6c-4c97-95d8-7a118922711a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.331335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced213a-be6c-4c97-95d8-7a118922711a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:45.333301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced213a-be6c-4c97-95d8-7a118922711a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:45.363660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1233/2477] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:17:45 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:17:45.368649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74051a3-0aa6-42dc-8e36-1bb775ae7730 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:45.380473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74051a3-0aa6-42dc-8e36-1bb775ae7730 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:45.391220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:45.457523 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65af8c-d02c-4fc8-9587-ef36b3f401c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:45.458308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65af8c-d02c-4fc8-9587-ef36b3f401c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.458655 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65af8c-d02c-4fc8-9587-ef36b3f401c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.458996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65af8c-d02c-4fc8-9587-ef36b3f401c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.459771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65af8c-d02c-4fc8-9587-ef36b3f401c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:45.461809 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65af8c-d02c-4fc8-9587-ef36b3f401c7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:45.488882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1245/2478] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:17:45 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:17:45.490174 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced213a-be6c-4c97-95d8-7a118922711a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:45.501163 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced213a-be6c-4c97-95d8-7a118922711a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:45.507152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8efb8-e399-4c04-9c94-0e6cb250dd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:45.507857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8efb8-e399-4c04-9c94-0e6cb250dd58 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.508135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8efb8-e399-4c04-9c94-0e6cb250dd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.508411 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8efb8-e399-4c04-9c94-0e6cb250dd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.509145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8efb8-e399-4c04-9c94-0e6cb250dd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:45.510875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8efb8-e399-4c04-9c94-0e6cb250dd58 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:45.522168 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1234/2479] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:17:45.526312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65af8c-d02c-4fc8-9587-ef36b3f401c7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:45.536914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65af8c-d02c-4fc8-9587-ef36b3f401c7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:45.542292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90db99-930f-4f0f-aa16-eb767cacbb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:45.543204 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90db99-930f-4f0f-aa16-eb767cacbb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.543482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90db99-930f-4f0f-aa16-eb767cacbb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.543754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90db99-930f-4f0f-aa16-eb767cacbb72 admin admin] PATH_INFO: `/v3/projects/86606e95c29e4089a92c90f013d03312/users/c85a440c086f458aa12e7ae4e66c049a/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.559729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90db99-930f-4f0f-aa16-eb767cacbb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86606e95c29e4089a92c90f013d03312, user_id=c85a440c086f458aa12e7ae4e66c049a, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:45.562432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90db99-930f-4f0f-aa16-eb767cacbb72 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:45.577774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1246/2480] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:17:45 2022] PUT /identity/v3/projects/86606e95c29e4089a92c90f013d03312/users/c85a440c086f458aa12e7ae4e66c049a/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:17:45.582390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8efb8-e399-4c04-9c94-0e6cb250dd58 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:45.592897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8efb8-e399-4c04-9c94-0e6cb250dd58 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:45.664368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:45.672140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d25812-de9d-49f8-9362-e4f4f7e725bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:45.672783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d25812-de9d-49f8-9362-e4f4f7e725bb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.673657 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d25812-de9d-49f8-9362-e4f4f7e725bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.675251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d25812-de9d-49f8-9362-e4f4f7e725bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.678091 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d25812-de9d-49f8-9362-e4f4f7e725bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:45.679919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d25812-de9d-49f8-9362-e4f4f7e725bb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:45.693703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1235/2481] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:17:45.697456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90db99-930f-4f0f-aa16-eb767cacbb72 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:45.709830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90db99-930f-4f0f-aa16-eb767cacbb72 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:45.716430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e309-b053-47ae-a8c1-ea5cf83160a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:45.717573 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e309-b053-47ae-a8c1-ea5cf83160a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.717858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e309-b053-47ae-a8c1-ea5cf83160a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.718137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e309-b053-47ae-a8c1-ea5cf83160a2 admin admin] PATH_INFO: `/v3/projects/86606e95c29e4089a92c90f013d03312/users/c85a440c086f458aa12e7ae4e66c049a/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.720443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55e309-b053-47ae-a8c1-ea5cf83160a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86606e95c29e4089a92c90f013d03312, user_id=c85a440c086f458aa12e7ae4e66c049a, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:45.724038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55e309-b053-47ae-a8c1-ea5cf83160a2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:45.735167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1247/2482] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:17:45 2022] PUT /identity/v3/projects/86606e95c29e4089a92c90f013d03312/users/c85a440c086f458aa12e7ae4e66c049a/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:45.747461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ef465-22ae-4f33-8099-b40d308f497e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.748077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ef465-22ae-4f33-8099-b40d308f497e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.748507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ef465-22ae-4f33-8099-b40d308f497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.781982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-904ef465-22ae-4f33-8099-b40d308f497e None None] MFA Rules not processed for user `c85a440c086f458aa12e7ae4e66c049a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:45.785178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-904ef465-22ae-4f33-8099-b40d308f497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:45.875505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1236/2483] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:45.887962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e309-b053-47ae-a8c1-ea5cf83160a2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:45.889804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dd55e309-b053-47ae-a8c1-ea5cf83160a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:45.969309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e309-b053-47ae-a8c1-ea5cf83160a2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:45.975196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c0919-4ecf-4957-b44a-ebab4c10047d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:45.976668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c0919-4ecf-4957-b44a-ebab4c10047d service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:45.977405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c0919-4ecf-4957-b44a-ebab4c10047d service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:45.977882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c0919-4ecf-4957-b44a-ebab4c10047d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:45.991286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c0919-4ecf-4957-b44a-ebab4c10047d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:45.992756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c0919-4ecf-4957-b44a-ebab4c10047d service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:46.003917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1248/2484] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:46.090755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ef465-22ae-4f33-8099-b40d308f497e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:46.102452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ef465-22ae-4f33-8099-b40d308f497e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:46.108731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e0d0d-2557-467b-8a57-655a0dc48d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:46.110188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e0d0d-2557-467b-8a57-655a0dc48d8c service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:46.110481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e0d0d-2557-467b-8a57-655a0dc48d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:46.110858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e0d0d-2557-467b-8a57-655a0dc48d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:46.192379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e0d0d-2557-467b-8a57-655a0dc48d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:46.193905 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e0d0d-2557-467b-8a57-655a0dc48d8c service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:46.205449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1237/2485] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:46.570692 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae9f1-3d6d-4653-903a-f5c3bced6606 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:46.571249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae9f1-3d6d-4653-903a-f5c3bced6606 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:46.571249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae9f1-3d6d-4653-903a-f5c3bced6606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:46.590300 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bcaae9f1-3d6d-4653-903a-f5c3bced6606 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:46.591486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bcaae9f1-3d6d-4653-903a-f5c3bced6606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:46.660878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1249/2486] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Jun 17 15:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:46.683668 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e0d0d-2557-467b-8a57-655a0dc48d8c service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:46.685280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b88e0d0d-2557-467b-8a57-655a0dc48d8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:46.764973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e0d0d-2557-467b-8a57-655a0dc48d8c service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:46.770818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13ea2c-b2c5-40f7-9ebe-8fd6f6e53c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:46.772129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13ea2c-b2c5-40f7-9ebe-8fd6f6e53c6a service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:46.772129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13ea2c-b2c5-40f7-9ebe-8fd6f6e53c6a service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:46.772129 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13ea2c-b2c5-40f7-9ebe-8fd6f6e53c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:46.781502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13ea2c-b2c5-40f7-9ebe-8fd6f6e53c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:46.783159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13ea2c-b2c5-40f7-9ebe-8fd6f6e53c6a service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:46.797119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1238/2487] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:48.511701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae9f1-3d6d-4653-903a-f5c3bced6606 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:48.525954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae9f1-3d6d-4653-903a-f5c3bced6606 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:48.532668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4938af-e200-4e55-801b-72df60867771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:48.533337 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4938af-e200-4e55-801b-72df60867771 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:48.533616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4938af-e200-4e55-801b-72df60867771 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:48.533877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4938af-e200-4e55-801b-72df60867771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:48.536295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3a4938af-e200-4e55-801b-72df60867771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:48.542799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:48.604979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4938af-e200-4e55-801b-72df60867771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:48.606618 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4938af-e200-4e55-801b-72df60867771 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:48.616996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1250/2488] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:53.111573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13ea2c-b2c5-40f7-9ebe-8fd6f6e53c6a service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:53.116674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:53.123577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13ea2c-b2c5-40f7-9ebe-8fd6f6e53c6a service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:53.128982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:53.129895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:53.130167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:53.130440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] PATH_INFO: `/v3/users/dc43f90a98b44985ab6baabca6e9296f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:53.131636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc43f90a98b44985ab6baabca6e9296f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:53.133603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:53.194457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc43f90a98b44985ab6baabca6e9296f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.202223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc43f90a98b44985ab6baabca6e9296f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.202919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc43f90a98b44985ab6baabca6e9296f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.211964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc43f90a98b44985ab6baabca6e9296f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.223916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc43f90a98b44985ab6baabca6e9296f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.229857 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1239/2489] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:17:53 2022] DELETE /identity/v3/users/dc43f90a98b44985ab6baabca6e9296f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:53.234589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd52fa-4cad-4026-b0f8-db4f6a71871b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:53.235090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd52fa-4cad-4026-b0f8-db4f6a71871b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:53.235212 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd52fa-4cad-4026-b0f8-db4f6a71871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:53.253097 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-10fd52fa-4cad-4026-b0f8-db4f6a71871b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:53.254524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-10fd52fa-4cad-4026-b0f8-db4f6a71871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:53.317140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1251/2490] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:53.330028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:53.331496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:53.389526 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ad274-3fa6-40a4-8a34-6beb7d011044 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:53.393750 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa149e-5510-4a6a-8267-96bf6a6f0c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:53.394434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa149e-5510-4a6a-8267-96bf6a6f0c52 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:53.394716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa149e-5510-4a6a-8267-96bf6a6f0c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:53.395035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa149e-5510-4a6a-8267-96bf6a6f0c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:53.404732 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa149e-5510-4a6a-8267-96bf6a6f0c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:53.406206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa149e-5510-4a6a-8267-96bf6a6f0c52 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:53.416296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1240/2491] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:53.705859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd52fa-4cad-4026-b0f8-db4f6a71871b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:53.707368 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-10fd52fa-4cad-4026-b0f8-db4f6a71871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:53.725983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd52fa-4cad-4026-b0f8-db4f6a71871b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:53.732381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:53.733528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:53.733864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:53.734193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] PATH_INFO: `/v3/projects/ef4a5e17051a46f5a3e9bfc3f9e3f472` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:53.735570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4a5e17051a46f5a3e9bfc3f9e3f472)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:53.737551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:53.783770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4a5e17051a46f5a3e9bfc3f9e3f472', 'request_id': 'req-432da1b8-8036-4e60-b325-e4d5f6f36c2d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.790460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4a5e17051a46f5a3e9bfc3f9e3f472', 'request_id': 'req-432da1b8-8036-4e60-b325-e4d5f6f36c2d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.800179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4a5e17051a46f5a3e9bfc3f9e3f472', 'request_id': 'req-432da1b8-8036-4e60-b325-e4d5f6f36c2d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.811763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] The token cache is being invalidate because project ef4a5e17051a46f5a3e9bfc3f9e3f472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:17:53.812131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.812764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.814648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1252/2492] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:17:53 2022] DELETE /identity/v3/projects/ef4a5e17051a46f5a3e9bfc3f9e3f472 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:53.819040 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa149e-5510-4a6a-8267-96bf6a6f0c52 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:53.828960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa149e-5510-4a6a-8267-96bf6a6f0c52 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:53.896686 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:53.897600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:53.897884 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:53.898155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] PATH_INFO: `/v3/users/c85a440c086f458aa12e7ae4e66c049a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:53.899385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85a440c086f458aa12e7ae4e66c049a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:53.901350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:53.923595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:53.955316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85a440c086f458aa12e7ae4e66c049a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.962755 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85a440c086f458aa12e7ae4e66c049a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.963505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85a440c086f458aa12e7ae4e66c049a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.973102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85a440c086f458aa12e7ae4e66c049a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:53.992948 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f6fea496-76be-4869-b22b-8dd672e045e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85a440c086f458aa12e7ae4e66c049a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:54.003171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1241/2493] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:17:53 2022] DELETE /identity/v3/users/c85a440c086f458aa12e7ae4e66c049a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:54.336043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:54.337653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:54.351348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432da1b8-8036-4e60-b325-e4d5f6f36c2d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:54.381241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:54.410037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:54.410904 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:54.411180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:54.411451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] PATH_INFO: `/v3/projects/86606e95c29e4089a92c90f013d03312` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:54.412794 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86606e95c29e4089a92c90f013d03312)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:54.414644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:54.464538 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86606e95c29e4089a92c90f013d03312', 'request_id': 'req-67a699a0-b893-408c-b9ef-c9172092be69'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:54.470518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86606e95c29e4089a92c90f013d03312', 'request_id': 'req-67a699a0-b893-408c-b9ef-c9172092be69'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:54.479547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86606e95c29e4089a92c90f013d03312', 'request_id': 'req-67a699a0-b893-408c-b9ef-c9172092be69'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:54.491380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] The token cache is being invalidate because project 86606e95c29e4089a92c90f013d03312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:17:54.491672 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:54.492424 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67a699a0-b893-408c-b9ef-c9172092be69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:54.494212 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1253/2494] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:17:54 2022] DELETE /identity/v3/projects/86606e95c29e4089a92c90f013d03312 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:54.501159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51e38b-fc2d-4e76-8337-d87cf8b6f8d9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:54.501667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51e38b-fc2d-4e76-8337-d87cf8b6f8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:54.501812 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51e38b-fc2d-4e76-8337-d87cf8b6f8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:54.521027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2e51e38b-fc2d-4e76-8337-d87cf8b6f8d9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:54.522406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2e51e38b-fc2d-4e76-8337-d87cf8b6f8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:54.583178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1242/2495] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:54.591881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe319-9a70-41f8-a788-3908dee4b12c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:54.592260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe319-9a70-41f8-a788-3908dee4b12c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:54.592695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe319-9a70-41f8-a788-3908dee4b12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:54.616230 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a35fe319-9a70-41f8-a788-3908dee4b12c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:54.617665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a35fe319-9a70-41f8-a788-3908dee4b12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:54.627260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1254/2496] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:54.631953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51e38b-fc2d-4e76-8337-d87cf8b6f8d9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:54.641685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51e38b-fc2d-4e76-8337-d87cf8b6f8d9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:54.646378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473afd6-43a1-4081-9208-9b508f9f5324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:54.647030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473afd6-43a1-4081-9208-9b508f9f5324 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:54.647314 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473afd6-43a1-4081-9208-9b508f9f5324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:54.647585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473afd6-43a1-4081-9208-9b508f9f5324 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:54.648302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473afd6-43a1-4081-9208-9b508f9f5324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:17:54.648606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473afd6-43a1-4081-9208-9b508f9f5324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:54.650240 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473afd6-43a1-4081-9208-9b508f9f5324 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:54.667013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1243/2497] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:17:54.668517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fe319-9a70-41f8-a788-3908dee4b12c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:54.678235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fe319-9a70-41f8-a788-3908dee4b12c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:54.683115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ae196-4a75-4934-968b-b1cb07397b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:54.683788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae196-4a75-4934-968b-b1cb07397b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:54.684084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae196-4a75-4934-968b-b1cb07397b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:54.684357 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae196-4a75-4934-968b-b1cb07397b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:54.685236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ae196-4a75-4934-968b-b1cb07397b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:54.686990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ae196-4a75-4934-968b-b1cb07397b36 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:54.716999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1255/2498] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:17:54 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:17:54.721107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473afd6-43a1-4081-9208-9b508f9f5324 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:54.735406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473afd6-43a1-4081-9208-9b508f9f5324 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:54.795033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9fc0e-7f90-4c55-b0a2-638f567ab5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:54.795422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9fc0e-7f90-4c55-b0a2-638f567ab5cb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:54.795731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9fc0e-7f90-4c55-b0a2-638f567ab5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:54.796008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9fc0e-7f90-4c55-b0a2-638f567ab5cb admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:54.797137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9fc0e-7f90-4c55-b0a2-638f567ab5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:54.798720 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9fc0e-7f90-4c55-b0a2-638f567ab5cb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:54.825053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1244/2499] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:17:54 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:17:54.826386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ae196-4a75-4934-968b-b1cb07397b36 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:54.840325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ae196-4a75-4934-968b-b1cb07397b36 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:54.847110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a26c41-54df-4ac9-bf65-a7648b116858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:54.848003 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26c41-54df-4ac9-bf65-a7648b116858 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:54.848350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26c41-54df-4ac9-bf65-a7648b116858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:54.848684 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26c41-54df-4ac9-bf65-a7648b116858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:54.849529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a26c41-54df-4ac9-bf65-a7648b116858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:54.851311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a26c41-54df-4ac9-bf65-a7648b116858 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:54.862705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1256/2500] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:17:54.866856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9fc0e-7f90-4c55-b0a2-638f567ab5cb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:54.877038 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9fc0e-7f90-4c55-b0a2-638f567ab5cb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:54.882063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08de590-f4c8-4ed2-bcf7-c4cd3acf5d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:54.882673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08de590-f4c8-4ed2-bcf7-c4cd3acf5d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:54.882956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08de590-f4c8-4ed2-bcf7-c4cd3acf5d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:54.883232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08de590-f4c8-4ed2-bcf7-c4cd3acf5d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:54.884029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08de590-f4c8-4ed2-bcf7-c4cd3acf5d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:54.885681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08de590-f4c8-4ed2-bcf7-c4cd3acf5d07 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:54.897782 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1245/2501] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:17:54.901960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a26c41-54df-4ac9-bf65-a7648b116858 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:54.912156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a26c41-54df-4ac9-bf65-a7648b116858 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:54.916708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80252003-33ab-478a-9979-ca892986beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:54.917702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80252003-33ab-478a-9979-ca892986beba admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:54.917979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80252003-33ab-478a-9979-ca892986beba admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:54.918253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80252003-33ab-478a-9979-ca892986beba admin admin] PATH_INFO: `/v3/projects/cacf027c38d9466fa460955f2a7bbc99/users/fd07bd1a0a474838b2d11793e5df881e/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:54.932655 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80252003-33ab-478a-9979-ca892986beba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacf027c38d9466fa460955f2a7bbc99, user_id=fd07bd1a0a474838b2d11793e5df881e, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:54.935362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80252003-33ab-478a-9979-ca892986beba admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:54.950394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1257/2502] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:17:54 2022] PUT /identity/v3/projects/cacf027c38d9466fa460955f2a7bbc99/users/fd07bd1a0a474838b2d11793e5df881e/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:54.964133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be62c-b0cc-47f3-a89f-ca7c7a6350c1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:54.964421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be62c-b0cc-47f3-a89f-ca7c7a6350c1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:54.964748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be62c-b0cc-47f3-a89f-ca7c7a6350c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:54.971175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:54.994050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e09be62c-b0cc-47f3-a89f-ca7c7a6350c1 None None] MFA Rules not processed for user `fd07bd1a0a474838b2d11793e5df881e`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:54.995275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e09be62c-b0cc-47f3-a89f-ca7c7a6350c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:55.068416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1246/2503] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:55.073426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80252003-33ab-478a-9979-ca892986beba admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:55.134007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:55.137607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80252003-33ab-478a-9979-ca892986beba admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:55.143782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc95e4-24c2-4e3a-86c2-f6e59c222c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:55.144453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc95e4-24c2-4e3a-86c2-f6e59c222c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:55.145395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc95e4-24c2-4e3a-86c2-f6e59c222c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:55.145937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc95e4-24c2-4e3a-86c2-f6e59c222c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:55.146736 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc95e4-24c2-4e3a-86c2-f6e59c222c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:55.148791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc95e4-24c2-4e3a-86c2-f6e59c222c1f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:55.176443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1258/2504] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:17:55 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:17:55.180740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09be62c-b0cc-47f3-a89f-ca7c7a6350c1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:55.192300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09be62c-b0cc-47f3-a89f-ca7c7a6350c1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:55.256504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9534-d790-49a4-855a-fdadd0409df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:55.257172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9534-d790-49a4-855a-fdadd0409df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:55.257489 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9534-d790-49a4-855a-fdadd0409df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:55.257767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9534-d790-49a4-855a-fdadd0409df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:55.258456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed9534-d790-49a4-855a-fdadd0409df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:55.260387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed9534-d790-49a4-855a-fdadd0409df7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:55.282248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1247/2505] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:17:55 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:17:55.286432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc95e4-24c2-4e3a-86c2-f6e59c222c1f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:55.297475 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc95e4-24c2-4e3a-86c2-f6e59c222c1f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:55.303043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e7f43-0e77-49fd-9bca-3c2c06176f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:55.303712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e7f43-0e77-49fd-9bca-3c2c06176f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:55.303999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e7f43-0e77-49fd-9bca-3c2c06176f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:55.304253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e7f43-0e77-49fd-9bca-3c2c06176f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:55.304995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e7f43-0e77-49fd-9bca-3c2c06176f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:55.306619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e7f43-0e77-49fd-9bca-3c2c06176f61 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:55.318142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1259/2506] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:17:55.322849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9534-d790-49a4-855a-fdadd0409df7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:55.339298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9534-d790-49a4-855a-fdadd0409df7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:55.347998 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c09b04-192d-43b1-9da4-475d7d7d489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:55.349549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c09b04-192d-43b1-9da4-475d7d7d489c admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:55.349909 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c09b04-192d-43b1-9da4-475d7d7d489c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:55.350188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c09b04-192d-43b1-9da4-475d7d7d489c admin admin] PATH_INFO: `/v3/projects/5133289fb3a442698732c860621c5529/users/11dfe7f95e7446ad817418cd54ee9e29/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:55.366961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c09b04-192d-43b1-9da4-475d7d7d489c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5133289fb3a442698732c860621c5529, user_id=11dfe7f95e7446ad817418cd54ee9e29, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:55.371337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c09b04-192d-43b1-9da4-475d7d7d489c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:55.389330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1248/2507] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:17:55 2022] PUT /identity/v3/projects/5133289fb3a442698732c860621c5529/users/11dfe7f95e7446ad817418cd54ee9e29/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:55.393430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e7f43-0e77-49fd-9bca-3c2c06176f61 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:55.404121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e7f43-0e77-49fd-9bca-3c2c06176f61 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:55.471563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd7490-bbde-4312-ac99-7302b72520c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:55.472227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7490-bbde-4312-ac99-7302b72520c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:55.472507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7490-bbde-4312-ac99-7302b72520c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:55.472778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7490-bbde-4312-ac99-7302b72520c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:55.473513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd7490-bbde-4312-ac99-7302b72520c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:55.475161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd7490-bbde-4312-ac99-7302b72520c1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:55.485307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1260/2508] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:17:55.489701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c09b04-192d-43b1-9da4-475d7d7d489c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:55.500796 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c09b04-192d-43b1-9da4-475d7d7d489c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:55.506529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fd978-8be8-402c-95f7-aa72a776ee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:55.507410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fd978-8be8-402c-95f7-aa72a776ee65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:55.507703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fd978-8be8-402c-95f7-aa72a776ee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:55.507978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fd978-8be8-402c-95f7-aa72a776ee65 admin admin] PATH_INFO: `/v3/projects/5133289fb3a442698732c860621c5529/users/11dfe7f95e7446ad817418cd54ee9e29/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:55.510031 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fd978-8be8-402c-95f7-aa72a776ee65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5133289fb3a442698732c860621c5529, user_id=11dfe7f95e7446ad817418cd54ee9e29, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:55.512761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fd978-8be8-402c-95f7-aa72a776ee65 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:55.524613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1249/2509] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:17:55 2022] PUT /identity/v3/projects/5133289fb3a442698732c860621c5529/users/11dfe7f95e7446ad817418cd54ee9e29/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:55.536108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461818-15d5-41af-981e-99a57116b03d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:55.536391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461818-15d5-41af-981e-99a57116b03d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:55.536791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461818-15d5-41af-981e-99a57116b03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:55.567570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-82461818-15d5-41af-981e-99a57116b03d None None] MFA Rules not processed for user `11dfe7f95e7446ad817418cd54ee9e29`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:55.568803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-82461818-15d5-41af-981e-99a57116b03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:55.643552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1261/2510] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:55.656675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fd978-8be8-402c-95f7-aa72a776ee65 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:55.658627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fd8fd978-8be8-402c-95f7-aa72a776ee65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:55.712273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:55.725457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fd978-8be8-402c-95f7-aa72a776ee65 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:55.729158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a729ff-da17-48d9-9ad9-6258966cf9fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:55.729831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a729ff-da17-48d9-9ad9-6258966cf9fe service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:55.730106 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a729ff-da17-48d9-9ad9-6258966cf9fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:55.730379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a729ff-da17-48d9-9ad9-6258966cf9fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:55.739532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a729ff-da17-48d9-9ad9-6258966cf9fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:55.741089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a729ff-da17-48d9-9ad9-6258966cf9fe service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:55.750694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1250/2511] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:55.834728 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82461818-15d5-41af-981e-99a57116b03d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:55.846971 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82461818-15d5-41af-981e-99a57116b03d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:55.861665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d86fb9-ad05-40fc-8fbf-6c7da79d1c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:55.862463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d86fb9-ad05-40fc-8fbf-6c7da79d1c33 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:55.863056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d86fb9-ad05-40fc-8fbf-6c7da79d1c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:55.863274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d86fb9-ad05-40fc-8fbf-6c7da79d1c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:55.979150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:55.991456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d86fb9-ad05-40fc-8fbf-6c7da79d1c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:55.993535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d86fb9-ad05-40fc-8fbf-6c7da79d1c33 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:56.010675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1262/2512] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:17:56.059535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd00f8-329c-4317-87b9-75b961f7cb8c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:56.060172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd00f8-329c-4317-87b9-75b961f7cb8c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:56.060524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd00f8-329c-4317-87b9-75b961f7cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:56.084994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-95bd00f8-329c-4317-87b9-75b961f7cb8c None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:56.086272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-95bd00f8-329c-4317-87b9-75b961f7cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:56.174700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1251/2513] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:17:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:17:56.200124 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d86fb9-ad05-40fc-8fbf-6c7da79d1c33 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:56.202235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c4d86fb9-ad05-40fc-8fbf-6c7da79d1c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:56.287155 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d86fb9-ad05-40fc-8fbf-6c7da79d1c33 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:56.292772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce069ae-79a0-4fff-b87d-24a4cf498720 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:56.293507 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce069ae-79a0-4fff-b87d-24a4cf498720 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:56.293785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce069ae-79a0-4fff-b87d-24a4cf498720 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:56.294055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce069ae-79a0-4fff-b87d-24a4cf498720 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:56.303183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce069ae-79a0-4fff-b87d-24a4cf498720 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:56.304939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce069ae-79a0-4fff-b87d-24a4cf498720 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:56.314421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1263/2514] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:17:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:17:59.152785 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd00f8-329c-4317-87b9-75b961f7cb8c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:59.232171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd00f8-329c-4317-87b9-75b961f7cb8c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:59.236997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:59.237941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:59.238223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:59.238501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] PATH_INFO: `/v3/users/fd07bd1a0a474838b2d11793e5df881e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:59.240947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd07bd1a0a474838b2d11793e5df881e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:59.242956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:59.303446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd07bd1a0a474838b2d11793e5df881e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:59.310852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd07bd1a0a474838b2d11793e5df881e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:59.311583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd07bd1a0a474838b2d11793e5df881e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:59.320847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd07bd1a0a474838b2d11793e5df881e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:59.337402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd07bd1a0a474838b2d11793e5df881e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:17:59.344403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1252/2515] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:17:59 2022] DELETE /identity/v3/users/fd07bd1a0a474838b2d11793e5df881e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:17:59.349260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2459df-6c17-4294-951e-c5a730befd10 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:59.349889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2459df-6c17-4294-951e-c5a730befd10 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:59.350149 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2459df-6c17-4294-951e-c5a730befd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:59.369831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2f2459df-6c17-4294-951e-c5a730befd10 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:17:59.371271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2f2459df-6c17-4294-951e-c5a730befd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:59.445462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1264/2516] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:17:59.454822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:59.456622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:59.477146 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:59.534141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8113a-aeae-4091-b8df-c346cfa44575 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:59.537989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759a534-77ac-4814-b6ec-bf69f6dbaeb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:59.538901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759a534-77ac-4814-b6ec-bf69f6dbaeb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:59.539302 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759a534-77ac-4814-b6ec-bf69f6dbaeb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:59.539664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759a534-77ac-4814-b6ec-bf69f6dbaeb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:59.556147 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759a534-77ac-4814-b6ec-bf69f6dbaeb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:59.557730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759a534-77ac-4814-b6ec-bf69f6dbaeb8 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:17:59.569289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1253/2517] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:17:59.928705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2459df-6c17-4294-951e-c5a730befd10 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:17:59.930300 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2f2459df-6c17-4294-951e-c5a730befd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:17:59.963638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2459df-6c17-4294-951e-c5a730befd10 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:17:59.981937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:17:59.984101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:17:59.984765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:17:59.985269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] PATH_INFO: `/v3/projects/cacf027c38d9466fa460955f2a7bbc99` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:17:59.987089 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cacf027c38d9466fa460955f2a7bbc99)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:17:59.989417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:00.097093 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cacf027c38d9466fa460955f2a7bbc99', 'request_id': 'req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.104958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cacf027c38d9466fa460955f2a7bbc99', 'request_id': 'req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.122792 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cacf027c38d9466fa460955f2a7bbc99', 'request_id': 'req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.137091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] The token cache is being invalidate because project cacf027c38d9466fa460955f2a7bbc99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:18:00.138310 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.139020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.143935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1265/2518] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:17:59 2022] DELETE /identity/v3/projects/cacf027c38d9466fa460955f2a7bbc99 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:00.144989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759a534-77ac-4814-b6ec-bf69f6dbaeb8 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:00.156692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759a534-77ac-4814-b6ec-bf69f6dbaeb8 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:00.233005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:00.234171 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:00.234596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:00.235021 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] PATH_INFO: `/v3/users/11dfe7f95e7446ad817418cd54ee9e29` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:00.237077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11dfe7f95e7446ad817418cd54ee9e29)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:00.239195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:00.322933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11dfe7f95e7446ad817418cd54ee9e29'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.336241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11dfe7f95e7446ad817418cd54ee9e29'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.337365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11dfe7f95e7446ad817418cd54ee9e29'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.353086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11dfe7f95e7446ad817418cd54ee9e29'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.376167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b96db0f3-177a-4109-914d-d2390eb3d4a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11dfe7f95e7446ad817418cd54ee9e29'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.387343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1254/2519] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:18:00 2022] DELETE /identity/v3/users/11dfe7f95e7446ad817418cd54ee9e29 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:00.761290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:00.762788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:00.781979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:00.800851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32be5e-01cc-4b2a-a1ec-8d69ddc26492 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:00.904947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:00.905955 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:00.906278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:00.906580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] PATH_INFO: `/v3/projects/5133289fb3a442698732c860621c5529` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:00.907766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5133289fb3a442698732c860621c5529)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:00.910342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:00.985634 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5133289fb3a442698732c860621c5529', 'request_id': 'req-004cf8b2-ea06-466e-b51a-adeec5fe1595'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:00.993032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5133289fb3a442698732c860621c5529', 'request_id': 'req-004cf8b2-ea06-466e-b51a-adeec5fe1595'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:01.005178 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5133289fb3a442698732c860621c5529', 'request_id': 'req-004cf8b2-ea06-466e-b51a-adeec5fe1595'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:01.018862 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] The token cache is being invalidate because project 5133289fb3a442698732c860621c5529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:18:01.019500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:01.020209 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-004cf8b2-ea06-466e-b51a-adeec5fe1595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:01.027045 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1266/2520] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:18:00 2022] DELETE /identity/v3/projects/5133289fb3a442698732c860621c5529 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:01.028606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e884f-1852-4f3b-9340-b47a5a26fbe7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.028960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e884f-1852-4f3b-9340-b47a5a26fbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.029507 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e884f-1852-4f3b-9340-b47a5a26fbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.064435 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7f2e884f-1852-4f3b-9340-b47a5a26fbe7 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:01.066035 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7f2e884f-1852-4f3b-9340-b47a5a26fbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:01.105245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:01.158705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1255/2521] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:01.166688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f0636-08de-4750-8c4b-82e2031d8727 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.166969 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f0636-08de-4750-8c4b-82e2031d8727 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.167242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f0636-08de-4750-8c4b-82e2031d8727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.187660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-099f0636-08de-4750-8c4b-82e2031d8727 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:01.188957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-099f0636-08de-4750-8c4b-82e2031d8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:01.201020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1267/2522] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:01.202251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e884f-1852-4f3b-9340-b47a5a26fbe7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:01.212737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e884f-1852-4f3b-9340-b47a5a26fbe7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:01.217483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aa999-49de-4d10-8f07-d7f7f793b4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:01.218232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aa999-49de-4d10-8f07-d7f7f793b4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.218442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aa999-49de-4d10-8f07-d7f7f793b4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.218703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aa999-49de-4d10-8f07-d7f7f793b4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.219437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aa999-49de-4d10-8f07-d7f7f793b4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:18:01.219739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aa999-49de-4d10-8f07-d7f7f793b4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:01.221510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aa999-49de-4d10-8f07-d7f7f793b4f0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:01.236602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1256/2523] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:18:01.241772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f0636-08de-4750-8c4b-82e2031d8727 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:01.252022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f0636-08de-4750-8c4b-82e2031d8727 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:01.258947 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63d31e-cd67-497e-af1a-206661621a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:01.259660 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63d31e-cd67-497e-af1a-206661621a5c admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.259942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63d31e-cd67-497e-af1a-206661621a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.260217 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63d31e-cd67-497e-af1a-206661621a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.260931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63d31e-cd67-497e-af1a-206661621a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:01.262901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63d31e-cd67-497e-af1a-206661621a5c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:01.292795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1268/2524] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:18:01 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:01.297313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aa999-49de-4d10-8f07-d7f7f793b4f0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:01.308888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aa999-49de-4d10-8f07-d7f7f793b4f0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:01.381420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b03b03-fc90-4259-bd22-5cec023a0843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:01.382104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03b03-fc90-4259-bd22-5cec023a0843 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.382386 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03b03-fc90-4259-bd22-5cec023a0843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.382661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03b03-fc90-4259-bd22-5cec023a0843 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.383362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b03b03-fc90-4259-bd22-5cec023a0843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:01.385363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b03b03-fc90-4259-bd22-5cec023a0843 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:01.415421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63d31e-cd67-497e-af1a-206661621a5c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:01.416547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1257/2525] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:18:01 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:01.426445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63d31e-cd67-497e-af1a-206661621a5c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:01.432526 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2933f9-6f9b-4dba-bb2f-11376fb2f08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:01.433847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2933f9-6f9b-4dba-bb2f-11376fb2f08f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.433847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2933f9-6f9b-4dba-bb2f-11376fb2f08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.434051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2933f9-6f9b-4dba-bb2f-11376fb2f08f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.434674 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2933f9-6f9b-4dba-bb2f-11376fb2f08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:01.436375 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2933f9-6f9b-4dba-bb2f-11376fb2f08f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:01.449738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1269/2526] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:18:01.453842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b03b03-fc90-4259-bd22-5cec023a0843 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:01.465397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b03b03-fc90-4259-bd22-5cec023a0843 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:01.475980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5956a-eb87-48f7-996e-c67fceb499e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:01.476676 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5956a-eb87-48f7-996e-c67fceb499e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.476974 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5956a-eb87-48f7-996e-c67fceb499e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.477251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5956a-eb87-48f7-996e-c67fceb499e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.478001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5956a-eb87-48f7-996e-c67fceb499e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:01.479640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5956a-eb87-48f7-996e-c67fceb499e8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:01.496594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2933f9-6f9b-4dba-bb2f-11376fb2f08f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:01.503312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1258/2527] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:01.507392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2933f9-6f9b-4dba-bb2f-11376fb2f08f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:01.513647 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94df487-f504-4b9c-893e-7cd8a371b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:01.514814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94df487-f504-4b9c-893e-7cd8a371b428 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.515161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94df487-f504-4b9c-893e-7cd8a371b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.515543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94df487-f504-4b9c-893e-7cd8a371b428 admin admin] PATH_INFO: `/v3/projects/152cd0c0e8284f1dafb0994832efeb15/users/f985f354287e4311ab9a0c6ce35ed889/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.545725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94df487-f504-4b9c-893e-7cd8a371b428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=152cd0c0e8284f1dafb0994832efeb15, user_id=f985f354287e4311ab9a0c6ce35ed889, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:01.549001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94df487-f504-4b9c-893e-7cd8a371b428 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:01.566694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1270/2528] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:01 2022] PUT /identity/v3/projects/152cd0c0e8284f1dafb0994832efeb15/users/f985f354287e4311ab9a0c6ce35ed889/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:01.579270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ff671-13c4-435e-9cec-32c28db74015 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.579580 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ff671-13c4-435e-9cec-32c28db74015 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.579854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ff671-13c4-435e-9cec-32c28db74015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.617652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ad3ff671-13c4-435e-9cec-32c28db74015 None None] MFA Rules not processed for user `f985f354287e4311ab9a0c6ce35ed889`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:01.620629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ad3ff671-13c4-435e-9cec-32c28db74015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:01.717921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94df487-f504-4b9c-893e-7cd8a371b428 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:01.718731 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1259/2529] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:01.773593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:01.831539 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94df487-f504-4b9c-893e-7cd8a371b428 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:01.841451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15e36d-e8d2-4990-bd65-5b94efb1dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:01.842779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15e36d-e8d2-4990-bd65-5b94efb1dcaf admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.843343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15e36d-e8d2-4990-bd65-5b94efb1dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.844056 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15e36d-e8d2-4990-bd65-5b94efb1dcaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.844909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15e36d-e8d2-4990-bd65-5b94efb1dcaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:01.847034 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15e36d-e8d2-4990-bd65-5b94efb1dcaf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:01.893693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1271/2530] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:18:01 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:18:01.895664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ff671-13c4-435e-9cec-32c28db74015 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:01.914158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ff671-13c4-435e-9cec-32c28db74015 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:01.950493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:01.992789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100e866-a1ab-48e9-8879-e031c0a2c37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:01.994433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100e866-a1ab-48e9-8879-e031c0a2c37c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:01.994792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100e866-a1ab-48e9-8879-e031c0a2c37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:01.995573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100e866-a1ab-48e9-8879-e031c0a2c37c admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:01.996430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100e866-a1ab-48e9-8879-e031c0a2c37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:01.998728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100e866-a1ab-48e9-8879-e031c0a2c37c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:02.022105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1260/2531] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:18:01 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:02.026540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15e36d-e8d2-4990-bd65-5b94efb1dcaf admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:02.040461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15e36d-e8d2-4990-bd65-5b94efb1dcaf admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:02.046492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6816b2d-a0e3-45ec-a1a1-7e14e02703e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:02.047464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816b2d-a0e3-45ec-a1a1-7e14e02703e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.047743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816b2d-a0e3-45ec-a1a1-7e14e02703e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.048020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816b2d-a0e3-45ec-a1a1-7e14e02703e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.048772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6816b2d-a0e3-45ec-a1a1-7e14e02703e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:02.050478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6816b2d-a0e3-45ec-a1a1-7e14e02703e1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:02.066642 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1272/2532] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:02.068083 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100e866-a1ab-48e9-8879-e031c0a2c37c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:02.080582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100e866-a1ab-48e9-8879-e031c0a2c37c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:02.086726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231b418-e274-4906-bd8c-16918c55586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:02.087495 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231b418-e274-4906-bd8c-16918c55586b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.087830 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231b418-e274-4906-bd8c-16918c55586b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.088186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231b418-e274-4906-bd8c-16918c55586b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.088973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231b418-e274-4906-bd8c-16918c55586b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:02.090703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231b418-e274-4906-bd8c-16918c55586b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:02.109222 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1261/2533] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:02.117115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6816b2d-a0e3-45ec-a1a1-7e14e02703e1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:02.143027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6816b2d-a0e3-45ec-a1a1-7e14e02703e1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:02.157969 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213630-509d-40a8-b32d-0ed47bacebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:02.166128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213630-509d-40a8-b32d-0ed47bacebad admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.166866 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213630-509d-40a8-b32d-0ed47bacebad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.167267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213630-509d-40a8-b32d-0ed47bacebad admin admin] PATH_INFO: `/v3/projects/139306b67da149a2989deb8ebbf37737/users/e55778caad964c7d8d0634118becfdbe/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.185436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc213630-509d-40a8-b32d-0ed47bacebad admin admin] RBAC: Authorizing `identity:create_grant(project_id=139306b67da149a2989deb8ebbf37737, user_id=e55778caad964c7d8d0634118becfdbe, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:02.188636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc213630-509d-40a8-b32d-0ed47bacebad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:02.206977 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1273/2534] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:02 2022] PUT /identity/v3/projects/139306b67da149a2989deb8ebbf37737/users/e55778caad964c7d8d0634118becfdbe/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:02.217786 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8aa58-1fb9-4016-ac3f-6f42dda0943b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.218161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8aa58-1fb9-4016-ac3f-6f42dda0943b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.218251 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8aa58-1fb9-4016-ac3f-6f42dda0943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.255931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9cf8aa58-1fb9-4016-ac3f-6f42dda0943b None None] MFA Rules not processed for user `e55778caad964c7d8d0634118becfdbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:02.257370 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9cf8aa58-1fb9-4016-ac3f-6f42dda0943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:02.335451 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1262/2535] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:02.340272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213630-509d-40a8-b32d-0ed47bacebad admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:02.416305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213630-509d-40a8-b32d-0ed47bacebad admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:02.421040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77139a93-9e7a-4c65-a56b-00502c838e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:02.421752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77139a93-9e7a-4c65-a56b-00502c838e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.422037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77139a93-9e7a-4c65-a56b-00502c838e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.422315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77139a93-9e7a-4c65-a56b-00502c838e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.423028 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77139a93-9e7a-4c65-a56b-00502c838e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:02.425116 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77139a93-9e7a-4c65-a56b-00502c838e07 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:02.460449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1274/2536] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:18:02 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:02.465332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8aa58-1fb9-4016-ac3f-6f42dda0943b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:02.478809 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8aa58-1fb9-4016-ac3f-6f42dda0943b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:02.545736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d36d-5908-4ee0-86b3-4e5c424ab6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:02.546390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d36d-5908-4ee0-86b3-4e5c424ab6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.546706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d36d-5908-4ee0-86b3-4e5c424ab6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.546958 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d36d-5908-4ee0-86b3-4e5c424ab6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.547681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188d36d-5908-4ee0-86b3-4e5c424ab6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:02.549887 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188d36d-5908-4ee0-86b3-4e5c424ab6c8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:02.580991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1263/2537] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:18:02 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:02.585316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77139a93-9e7a-4c65-a56b-00502c838e07 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:02.596331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77139a93-9e7a-4c65-a56b-00502c838e07 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:02.602199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c7bb-617a-457c-adb5-38c0e85caddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:02.602991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c7bb-617a-457c-adb5-38c0e85caddc admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.603271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c7bb-617a-457c-adb5-38c0e85caddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.603542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c7bb-617a-457c-adb5-38c0e85caddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.604272 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46c7bb-617a-457c-adb5-38c0e85caddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:02.605927 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46c7bb-617a-457c-adb5-38c0e85caddc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:02.618790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1275/2538] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:02.623673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d36d-5908-4ee0-86b3-4e5c424ab6c8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:02.635075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d36d-5908-4ee0-86b3-4e5c424ab6c8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:02.642057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc731f-9f85-40f1-967a-a581905033de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:02.643718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc731f-9f85-40f1-967a-a581905033de admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.644194 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc731f-9f85-40f1-967a-a581905033de admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.644588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc731f-9f85-40f1-967a-a581905033de admin admin] PATH_INFO: `/v3/projects/47535e80fbd646019c63b4b5245756a4/users/d4ca59c90635410b929145ffe78dfd8b/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.664665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc731f-9f85-40f1-967a-a581905033de admin admin] RBAC: Authorizing `identity:create_grant(project_id=47535e80fbd646019c63b4b5245756a4, user_id=d4ca59c90635410b929145ffe78dfd8b, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:02.667481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc731f-9f85-40f1-967a-a581905033de admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:02.688236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1264/2539] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:02 2022] PUT /identity/v3/projects/47535e80fbd646019c63b4b5245756a4/users/d4ca59c90635410b929145ffe78dfd8b/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:02.692676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c7bb-617a-457c-adb5-38c0e85caddc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:02.704894 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c7bb-617a-457c-adb5-38c0e85caddc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:02.771353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:02.779317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc9948-e630-4c37-b4fd-a533196b8718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:02.781554 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc9948-e630-4c37-b4fd-a533196b8718 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.782275 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc9948-e630-4c37-b4fd-a533196b8718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.782614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc9948-e630-4c37-b4fd-a533196b8718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.783843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc9948-e630-4c37-b4fd-a533196b8718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:02.785572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc9948-e630-4c37-b4fd-a533196b8718 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:02.801076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1276/2540] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:18:02.802402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc731f-9f85-40f1-967a-a581905033de admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:02.808345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:02.815681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc731f-9f85-40f1-967a-a581905033de admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:02.827415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0730279-7f25-4063-beae-892c53d8a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:02.828333 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0730279-7f25-4063-beae-892c53d8a013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.828618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0730279-7f25-4063-beae-892c53d8a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.828901 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0730279-7f25-4063-beae-892c53d8a013 admin admin] PATH_INFO: `/v3/projects/47535e80fbd646019c63b4b5245756a4/users/d4ca59c90635410b929145ffe78dfd8b/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.831045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0730279-7f25-4063-beae-892c53d8a013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47535e80fbd646019c63b4b5245756a4, user_id=d4ca59c90635410b929145ffe78dfd8b, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:02.835291 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0730279-7f25-4063-beae-892c53d8a013 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:02.854402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1265/2541] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:02 2022] PUT /identity/v3/projects/47535e80fbd646019c63b4b5245756a4/users/d4ca59c90635410b929145ffe78dfd8b/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:02.864729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84373-a00b-45ad-a5ba-2edcd875347a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:02.865006 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84373-a00b-45ad-a5ba-2edcd875347a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:02.865317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84373-a00b-45ad-a5ba-2edcd875347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:02.892374 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d0e84373-a00b-45ad-a5ba-2edcd875347a None None] MFA Rules not processed for user `d4ca59c90635410b929145ffe78dfd8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:02.893620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d0e84373-a00b-45ad-a5ba-2edcd875347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:02.994952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1277/2542] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:03.012582 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0730279-7f25-4063-beae-892c53d8a013 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:03.015019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d0730279-7f25-4063-beae-892c53d8a013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:03.109694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0730279-7f25-4063-beae-892c53d8a013 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:03.114738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfa4f8-0ecc-4186-89f3-14718dcd44d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:03.115946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa4f8-0ecc-4186-89f3-14718dcd44d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:03.116583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa4f8-0ecc-4186-89f3-14718dcd44d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:03.117086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa4f8-0ecc-4186-89f3-14718dcd44d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:03.130091 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfa4f8-0ecc-4186-89f3-14718dcd44d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:03.132229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfa4f8-0ecc-4186-89f3-14718dcd44d2 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:03.145502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1266/2543] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:03.210648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84373-a00b-45ad-a5ba-2edcd875347a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:03.212589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d0e84373-a00b-45ad-a5ba-2edcd875347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:03.226829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84373-a00b-45ad-a5ba-2edcd875347a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:03.231098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cb042-efd1-42e0-b31d-ce50e0cbc34c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:03.231974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cb042-efd1-42e0-b31d-ce50e0cbc34c service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:03.232424 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cb042-efd1-42e0-b31d-ce50e0cbc34c service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:03.232707 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cb042-efd1-42e0-b31d-ce50e0cbc34c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:03.321433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cb042-efd1-42e0-b31d-ce50e0cbc34c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:03.323005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cb042-efd1-42e0-b31d-ce50e0cbc34c service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:03.334010 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1278/2544] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:06.405199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfa4f8-0ecc-4186-89f3-14718dcd44d2 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:06.476560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfa4f8-0ecc-4186-89f3-14718dcd44d2 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:06.481775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:06.482600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:06.482876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:06.483149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] PATH_INFO: `/v3/users/f985f354287e4311ab9a0c6ce35ed889` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:06.484425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f985f354287e4311ab9a0c6ce35ed889)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:06.486438 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:06.537696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f985f354287e4311ab9a0c6ce35ed889'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:06.545049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f985f354287e4311ab9a0c6ce35ed889'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:06.545806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f985f354287e4311ab9a0c6ce35ed889'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:06.555176 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f985f354287e4311ab9a0c6ce35ed889'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:06.567908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f985f354287e4311ab9a0c6ce35ed889'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:06.574623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1267/2545] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:18:06 2022] DELETE /identity/v3/users/f985f354287e4311ab9a0c6ce35ed889 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:06.580219 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e290a3-86b1-49bb-88d5-c3b87e837527 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:06.580735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e290a3-86b1-49bb-88d5-c3b87e837527 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:06.580836 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e290a3-86b1-49bb-88d5-c3b87e837527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:06.607444 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e2e290a3-86b1-49bb-88d5-c3b87e837527 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:06.608676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e2e290a3-86b1-49bb-88d5-c3b87e837527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:06.643561 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:06.645128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:06.660904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:06.672200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1279/2546] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:06.681990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e290a3-86b1-49bb-88d5-c3b87e837527 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:06.683343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e2e290a3-86b1-49bb-88d5-c3b87e837527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:06.703180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:06.715533 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bf39b-fbc9-4878-84f0-f66cd9ed82b0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:06.719406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d73cf-7f4f-4ac4-b3a5-14805a917941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:06.720064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d73cf-7f4f-4ac4-b3a5-14805a917941 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:06.720462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d73cf-7f4f-4ac4-b3a5-14805a917941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:06.720740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d73cf-7f4f-4ac4-b3a5-14805a917941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:06.723374 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b11d73cf-7f4f-4ac4-b3a5-14805a917941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:06.734109 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d73cf-7f4f-4ac4-b3a5-14805a917941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:06.735557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d73cf-7f4f-4ac4-b3a5-14805a917941 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:06.744267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1268/2547] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:18:06.745467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e290a3-86b1-49bb-88d5-c3b87e837527 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:06.749050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e15e58-47dd-4a68-8410-989f2c1e9c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:06.749739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e15e58-47dd-4a68-8410-989f2c1e9c95 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:06.750019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e15e58-47dd-4a68-8410-989f2c1e9c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:06.750290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e15e58-47dd-4a68-8410-989f2c1e9c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:06.760779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e15e58-47dd-4a68-8410-989f2c1e9c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:06.762314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e15e58-47dd-4a68-8410-989f2c1e9c95 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:06.772437 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1280/2548] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:18:07.359900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d73cf-7f4f-4ac4-b3a5-14805a917941 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:07.361406 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b11d73cf-7f4f-4ac4-b3a5-14805a917941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:07.377146 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d73cf-7f4f-4ac4-b3a5-14805a917941 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:07.382941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:07.383828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:07.384119 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:07.384772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] PATH_INFO: `/v3/projects/152cd0c0e8284f1dafb0994832efeb15` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:07.385764 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=152cd0c0e8284f1dafb0994832efeb15)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:07.387738 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:07.442446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152cd0c0e8284f1dafb0994832efeb15', 'request_id': 'req-e9e2f4b5-870f-471b-8467-9073d0cfdf42'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:07.449792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152cd0c0e8284f1dafb0994832efeb15', 'request_id': 'req-e9e2f4b5-870f-471b-8467-9073d0cfdf42'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:07.459530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152cd0c0e8284f1dafb0994832efeb15', 'request_id': 'req-e9e2f4b5-870f-471b-8467-9073d0cfdf42'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:07.474362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] The token cache is being invalidate because project 152cd0c0e8284f1dafb0994832efeb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:18:07.474646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:07.475412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:07.477108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1269/2549] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:18:07 2022] DELETE /identity/v3/projects/152cd0c0e8284f1dafb0994832efeb15 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:07.481308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e15e58-47dd-4a68-8410-989f2c1e9c95 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:07.491844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e15e58-47dd-4a68-8410-989f2c1e9c95 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:07.567519 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:07.568334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:07.568611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:07.568883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] PATH_INFO: `/v3/users/e55778caad964c7d8d0634118becfdbe` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:07.570198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55778caad964c7d8d0634118becfdbe)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:07.572129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:07.626225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55778caad964c7d8d0634118becfdbe'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:07.634038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55778caad964c7d8d0634118becfdbe'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:07.634739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55778caad964c7d8d0634118becfdbe'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:07.643420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55778caad964c7d8d0634118becfdbe'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:07.644032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55778caad964c7d8d0634118becfdbe'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:07.666718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1281/2550] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:18:07 2022] DELETE /identity/v3/users/e55778caad964c7d8d0634118becfdbe => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:07.997614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:08.000006 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:08.019690 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2f4b5-870f-471b-8467-9073d0cfdf42 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:08.097711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:08.098593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:08.098856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:08.099123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] PATH_INFO: `/v3/projects/139306b67da149a2989deb8ebbf37737` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:08.100348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=139306b67da149a2989deb8ebbf37737)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:08.102364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:08.152855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:08.163441 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139306b67da149a2989deb8ebbf37737', 'request_id': 'req-18245508-f4b1-465e-b3db-0387620bd9bf'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.171197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139306b67da149a2989deb8ebbf37737', 'request_id': 'req-18245508-f4b1-465e-b3db-0387620bd9bf'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.181409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139306b67da149a2989deb8ebbf37737', 'request_id': 'req-18245508-f4b1-465e-b3db-0387620bd9bf'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.195108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] The token cache is being invalidate because project 139306b67da149a2989deb8ebbf37737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:18:08.195419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.196116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.201476 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1270/2551] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:18:07 2022] DELETE /identity/v3/projects/139306b67da149a2989deb8ebbf37737 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:08.203762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:08.205346 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:08.221020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24409a3a-f97c-49bb-a691-42cb88388f3c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:08.259580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:08.288853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:08.290363 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:08.290651 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:08.290928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] PATH_INFO: `/v3/users/d4ca59c90635410b929145ffe78dfd8b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:08.292711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ca59c90635410b929145ffe78dfd8b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:08.295818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:08.354343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ca59c90635410b929145ffe78dfd8b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.363185 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ca59c90635410b929145ffe78dfd8b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.363930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ca59c90635410b929145ffe78dfd8b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.373886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ca59c90635410b929145ffe78dfd8b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.374783 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9d15657c-9e0b-4322-988c-5e7297e64341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ca59c90635410b929145ffe78dfd8b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.395574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1282/2552] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:18:08 2022] DELETE /identity/v3/users/d4ca59c90635410b929145ffe78dfd8b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:08.688301 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:08.689840 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:08.703917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18245508-f4b1-465e-b3db-0387620bd9bf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:08.771328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:08.772193 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:08.772454 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:08.772757 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] PATH_INFO: `/v3/projects/47535e80fbd646019c63b4b5245756a4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:08.774187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47535e80fbd646019c63b4b5245756a4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:08.776310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:08.828048 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47535e80fbd646019c63b4b5245756a4', 'request_id': 'req-f29590b3-cdf8-4544-b92b-54f843d3c640'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.834577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47535e80fbd646019c63b4b5245756a4', 'request_id': 'req-f29590b3-cdf8-4544-b92b-54f843d3c640'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.845705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47535e80fbd646019c63b4b5245756a4', 'request_id': 'req-f29590b3-cdf8-4544-b92b-54f843d3c640'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.857904 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] The token cache is being invalidate because project 47535e80fbd646019c63b4b5245756a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:18:08.858260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.858898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f29590b3-cdf8-4544-b92b-54f843d3c640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:08.860444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1271/2553] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:18:08 2022] DELETE /identity/v3/projects/47535e80fbd646019c63b4b5245756a4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:08.867565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72993ab4-dcdd-4351-9faf-6c820aca6e7a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:08.868076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72993ab4-dcdd-4351-9faf-6c820aca6e7a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:08.868183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72993ab4-dcdd-4351-9faf-6c820aca6e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:08.887858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-72993ab4-dcdd-4351-9faf-6c820aca6e7a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:08.889190 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-72993ab4-dcdd-4351-9faf-6c820aca6e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:08.958415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1283/2554] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:08.969037 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676611bf-a735-401e-a3ff-cf6920ff676c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:08.969353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676611bf-a735-401e-a3ff-cf6920ff676c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:08.969635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676611bf-a735-401e-a3ff-cf6920ff676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:08.989169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-676611bf-a735-401e-a3ff-cf6920ff676c None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:08.990415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-676611bf-a735-401e-a3ff-cf6920ff676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:08.998554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1272/2555] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:09.002976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72993ab4-dcdd-4351-9faf-6c820aca6e7a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:09.012942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72993ab4-dcdd-4351-9faf-6c820aca6e7a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:09.018018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165ed4f-352f-463e-9017-bb37051ae450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:09.018678 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ed4f-352f-463e-9017-bb37051ae450 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:09.018957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ed4f-352f-463e-9017-bb37051ae450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:09.019234 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ed4f-352f-463e-9017-bb37051ae450 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:09.019961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165ed4f-352f-463e-9017-bb37051ae450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:18:09.020258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165ed4f-352f-463e-9017-bb37051ae450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:09.021901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165ed4f-352f-463e-9017-bb37051ae450 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:09.033580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1284/2556] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:18:09.037890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676611bf-a735-401e-a3ff-cf6920ff676c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:09.047531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676611bf-a735-401e-a3ff-cf6920ff676c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:09.052440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f8b12-4669-46c8-ae01-5283ec52b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:09.053087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f8b12-4669-46c8-ae01-5283ec52b80d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:09.053421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f8b12-4669-46c8-ae01-5283ec52b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:09.053774 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f8b12-4669-46c8-ae01-5283ec52b80d admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:09.054475 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f8b12-4669-46c8-ae01-5283ec52b80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:09.056378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f8b12-4669-46c8-ae01-5283ec52b80d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:09.082660 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1273/2557] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:18:09 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:09.086893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165ed4f-352f-463e-9017-bb37051ae450 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:09.097038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165ed4f-352f-463e-9017-bb37051ae450 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:09.143425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:09.160550 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116984c-cc4d-421d-840f-663b267c27c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:09.161264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116984c-cc4d-421d-840f-663b267c27c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:09.161551 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116984c-cc4d-421d-840f-663b267c27c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:09.161831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116984c-cc4d-421d-840f-663b267c27c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:09.162603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116984c-cc4d-421d-840f-663b267c27c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:09.165252 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116984c-cc4d-421d-840f-663b267c27c0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:09.189060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1285/2558] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:18:09 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:09.193296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f8b12-4669-46c8-ae01-5283ec52b80d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:09.204602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f8b12-4669-46c8-ae01-5283ec52b80d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:09.209148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831a3fe-6532-48ed-a90c-23007d9dbc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:09.209966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831a3fe-6532-48ed-a90c-23007d9dbc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:09.210275 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831a3fe-6532-48ed-a90c-23007d9dbc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:09.210760 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831a3fe-6532-48ed-a90c-23007d9dbc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:09.211320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831a3fe-6532-48ed-a90c-23007d9dbc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:09.212950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831a3fe-6532-48ed-a90c-23007d9dbc27 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:09.223996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1274/2559] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:09.228464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116984c-cc4d-421d-840f-663b267c27c0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:09.239740 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116984c-cc4d-421d-840f-663b267c27c0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:09.245942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05519b51-b310-47c2-a349-719ccf15d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:09.246633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519b51-b310-47c2-a349-719ccf15d229 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:09.246918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519b51-b310-47c2-a349-719ccf15d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:09.247196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519b51-b310-47c2-a349-719ccf15d229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:09.247935 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05519b51-b310-47c2-a349-719ccf15d229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:09.249665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05519b51-b310-47c2-a349-719ccf15d229 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:09.266063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1286/2560] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:09.271309 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831a3fe-6532-48ed-a90c-23007d9dbc27 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:09.281714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831a3fe-6532-48ed-a90c-23007d9dbc27 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:09.286706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78ab9a-2ce1-4543-8c25-6d4ba91ad334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:09.287610 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78ab9a-2ce1-4543-8c25-6d4ba91ad334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:09.287945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78ab9a-2ce1-4543-8c25-6d4ba91ad334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:09.288265 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78ab9a-2ce1-4543-8c25-6d4ba91ad334 admin admin] PATH_INFO: `/v3/projects/ba639f577af846e3a18319333083c760/users/45ce66554c2e49338cb82c952f735fb9/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:09.305560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78ab9a-2ce1-4543-8c25-6d4ba91ad334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba639f577af846e3a18319333083c760, user_id=45ce66554c2e49338cb82c952f735fb9, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:09.311267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78ab9a-2ce1-4543-8c25-6d4ba91ad334 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:09.314359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:09.337104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1275/2561] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:09 2022] PUT /identity/v3/projects/ba639f577af846e3a18319333083c760/users/45ce66554c2e49338cb82c952f735fb9/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:09.348485 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a0936-e9ef-4b6c-aa26-ccf38a58208f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:09.348774 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a0936-e9ef-4b6c-aa26-ccf38a58208f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:09.349051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a0936-e9ef-4b6c-aa26-ccf38a58208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:09.386578 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-707a0936-e9ef-4b6c-aa26-ccf38a58208f None None] MFA Rules not processed for user `45ce66554c2e49338cb82c952f735fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:09.387756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-707a0936-e9ef-4b6c-aa26-ccf38a58208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:09.455494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1287/2562] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:09.469172 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78ab9a-2ce1-4543-8c25-6d4ba91ad334 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:09.471306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9f78ab9a-2ce1-4543-8c25-6d4ba91ad334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:09.542403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78ab9a-2ce1-4543-8c25-6d4ba91ad334 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:09.546804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c152d3-0e49-476e-a9fa-9212fa924366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:09.547514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c152d3-0e49-476e-a9fa-9212fa924366 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:09.547950 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c152d3-0e49-476e-a9fa-9212fa924366 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:09.548237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c152d3-0e49-476e-a9fa-9212fa924366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:09.558114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c152d3-0e49-476e-a9fa-9212fa924366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:09.559712 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c152d3-0e49-476e-a9fa-9212fa924366 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:09.573802 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1276/2563] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:10.530473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a0936-e9ef-4b6c-aa26-ccf38a58208f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:10.532447 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-707a0936-e9ef-4b6c-aa26-ccf38a58208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:10.601721 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a0936-e9ef-4b6c-aa26-ccf38a58208f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:10.606699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88628bf-5a2d-41c7-b8a7-35f17a1c16f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:10.607486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88628bf-5a2d-41c7-b8a7-35f17a1c16f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:10.607840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88628bf-5a2d-41c7-b8a7-35f17a1c16f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:10.608225 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88628bf-5a2d-41c7-b8a7-35f17a1c16f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:10.611069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a88628bf-5a2d-41c7-b8a7-35f17a1c16f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:10.623512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88628bf-5a2d-41c7-b8a7-35f17a1c16f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:10.625071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88628bf-5a2d-41c7-b8a7-35f17a1c16f3 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:10.633409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1288/2564] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:10.962742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c152d3-0e49-476e-a9fa-9212fa924366 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:10.964247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-37c152d3-0e49-476e-a9fa-9212fa924366 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:11.039115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c152d3-0e49-476e-a9fa-9212fa924366 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:11.044573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a52ccb-e3ec-4033-b484-9597d122cf6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:11.045232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a52ccb-e3ec-4033-b484-9597d122cf6e service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:11.045519 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a52ccb-e3ec-4033-b484-9597d122cf6e service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:11.045798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a52ccb-e3ec-4033-b484-9597d122cf6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:11.047636 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-85a52ccb-e3ec-4033-b484-9597d122cf6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:11.059754 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a52ccb-e3ec-4033-b484-9597d122cf6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:11.061417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a52ccb-e3ec-4033-b484-9597d122cf6e service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:11.071958 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1277/2565] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:12.134646 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88628bf-5a2d-41c7-b8a7-35f17a1c16f3 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:12.195108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:12.202614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88628bf-5a2d-41c7-b8a7-35f17a1c16f3 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:12.207324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:12.208211 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:12.208514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:12.208776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] PATH_INFO: `/v3/users/45ce66554c2e49338cb82c952f735fb9` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:12.210092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ce66554c2e49338cb82c952f735fb9)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:12.212254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:12.262629 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ce66554c2e49338cb82c952f735fb9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:12.269637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ce66554c2e49338cb82c952f735fb9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:12.270315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ce66554c2e49338cb82c952f735fb9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:12.278643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ce66554c2e49338cb82c952f735fb9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:12.279318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ce66554c2e49338cb82c952f735fb9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:12.298252 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1289/2566] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:18:12 2022] DELETE /identity/v3/users/45ce66554c2e49338cb82c952f735fb9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:12.302946 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3e470-04c9-4100-afee-0731b436ac01 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:12.303456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3e470-04c9-4100-afee-0731b436ac01 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:12.303456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3e470-04c9-4100-afee-0731b436ac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:12.321710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-adc3e470-04c9-4100-afee-0731b436ac01 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:12.322961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-adc3e470-04c9-4100-afee-0731b436ac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:12.389736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1278/2567] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:12.399403 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:12.400975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:12.459684 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a06b-d216-4a90-9c5f-474d4550604b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:12.463448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2de133-b6e5-42ed-a7d6-d9dd65170626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:12.464107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de133-b6e5-42ed-a7d6-d9dd65170626 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:12.464393 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de133-b6e5-42ed-a7d6-d9dd65170626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:12.464672 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de133-b6e5-42ed-a7d6-d9dd65170626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:12.474156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2de133-b6e5-42ed-a7d6-d9dd65170626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:12.475709 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2de133-b6e5-42ed-a7d6-d9dd65170626 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:12.486829 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1290/2568] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:12.717149 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721cb71-8687-4ec4-b562-deb3351ddd2b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:12.717479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721cb71-8687-4ec4-b562-deb3351ddd2b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:12.717763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721cb71-8687-4ec4-b562-deb3351ddd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:12.739619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e721cb71-8687-4ec4-b562-deb3351ddd2b None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:12.740835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e721cb71-8687-4ec4-b562-deb3351ddd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:12.766433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:12.829266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1279/2569] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:12.847702 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2de133-b6e5-42ed-a7d6-d9dd65170626 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:12.849420 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4f2de133-b6e5-42ed-a7d6-d9dd65170626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:12.855831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721cb71-8687-4ec4-b562-deb3351ddd2b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:12.857259 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e721cb71-8687-4ec4-b562-deb3351ddd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:12.865534 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2de133-b6e5-42ed-a7d6-d9dd65170626 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:12.873019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:12.874100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:12.874527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:12.874716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] PATH_INFO: `/v3/projects/ba639f577af846e3a18319333083c760` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:12.876047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba639f577af846e3a18319333083c760)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:12.878094 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:12.942072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba639f577af846e3a18319333083c760', 'request_id': 'req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:12.949566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba639f577af846e3a18319333083c760', 'request_id': 'req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:12.959274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721cb71-8687-4ec4-b562-deb3351ddd2b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:12.960812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba639f577af846e3a18319333083c760', 'request_id': 'req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:12.968745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:12.972789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] The token cache is being invalidate because project ba639f577af846e3a18319333083c760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:18:12.973365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:12.974436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:12.976401 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1291/2570] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:18:12 2022] DELETE /identity/v3/projects/ba639f577af846e3a18319333083c760 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:13.026775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ae24-ae23-462b-99f6-4e9273b7ff4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:13.027447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ae24-ae23-462b-99f6-4e9273b7ff4a service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:13.027987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ae24-ae23-462b-99f6-4e9273b7ff4a service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:13.027987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ae24-ae23-462b-99f6-4e9273b7ff4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:13.029853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6924ae24-ae23-462b-99f6-4e9273b7ff4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:13.101013 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ae24-ae23-462b-99f6-4e9273b7ff4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:13.102910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ae24-ae23-462b-99f6-4e9273b7ff4a service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:13.114292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1280/2571] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 15:18:15.841599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:15.843145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:15.916512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e3ddf-4c06-44f3-8418-68d18cc27f7a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:15.921316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:15.922240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:15.922514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:15.922789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] PATH_INFO: `/v3/users/be4c6ca1cde040c5b3cf0f84789ca4ab` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:15.923986 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4c6ca1cde040c5b3cf0f84789ca4ab)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:15.925970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:15.989258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4c6ca1cde040c5b3cf0f84789ca4ab'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:15.997073 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4c6ca1cde040c5b3cf0f84789ca4ab'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:15.997839 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4c6ca1cde040c5b3cf0f84789ca4ab'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:16.007499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4c6ca1cde040c5b3cf0f84789ca4ab'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:16.008318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4c6ca1cde040c5b3cf0f84789ca4ab'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:16.028827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1292/2572] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:18:15 2022] DELETE /identity/v3/users/be4c6ca1cde040c5b3cf0f84789ca4ab => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:16.231876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ae24-ae23-462b-99f6-4e9273b7ff4a service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:16.245833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ae24-ae23-462b-99f6-4e9273b7ff4a service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:16.264375 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:16.323430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:16.324662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:16.324930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:16.325201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] PATH_INFO: `/v3/projects/1ecf4dbce5d341aa8c75518e75b5f6d1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:16.326461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ecf4dbce5d341aa8c75518e75b5f6d1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:16.328379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:16.386366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ecf4dbce5d341aa8c75518e75b5f6d1', 'request_id': 'req-e44c0041-445e-4df1-a233-f720ede57089'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:16.394096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ecf4dbce5d341aa8c75518e75b5f6d1', 'request_id': 'req-e44c0041-445e-4df1-a233-f720ede57089'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:16.403553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ecf4dbce5d341aa8c75518e75b5f6d1', 'request_id': 'req-e44c0041-445e-4df1-a233-f720ede57089'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:16.414992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] The token cache is being invalidate because project 1ecf4dbce5d341aa8c75518e75b5f6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:18:16.415397 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:16.415918 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e44c0041-445e-4df1-a233-f720ede57089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:16.417563 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1281/2573] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:18:16 2022] DELETE /identity/v3/projects/1ecf4dbce5d341aa8c75518e75b5f6d1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:26.025472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:26.341952 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:26.344797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:26.411531 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:26.437765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf41a1-d5f8-4d02-8633-6165eef68394 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:26.503676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bb7e1-35f1-4d79-aeae-534aa974d510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:26.504350 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bb7e1-35f1-4d79-aeae-534aa974d510 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:26.504635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bb7e1-35f1-4d79-aeae-534aa974d510 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:26.504914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bb7e1-35f1-4d79-aeae-534aa974d510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:26.506820 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3d7bb7e1-35f1-4d79-aeae-534aa974d510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:26.520011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bb7e1-35f1-4d79-aeae-534aa974d510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:26.521661 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bb7e1-35f1-4d79-aeae-534aa974d510 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:26.532217 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1293/2574] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:28.082698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eca2b-170c-4709-95a2-8a805b1ae6c4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:28.083227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eca2b-170c-4709-95a2-8a805b1ae6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:28.083227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eca2b-170c-4709-95a2-8a805b1ae6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:28.103560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1e3eca2b-170c-4709-95a2-8a805b1ae6c4 None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:28.104781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1e3eca2b-170c-4709-95a2-8a805b1ae6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:28.167609 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1282/2575] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 17 15:18:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:28.180844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bb7e1-35f1-4d79-aeae-534aa974d510 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:28.183228 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3d7bb7e1-35f1-4d79-aeae-534aa974d510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:28.263601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bb7e1-35f1-4d79-aeae-534aa974d510 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:28.269397 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee013b-5dac-4788-a138-068eb05855ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:28.270043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee013b-5dac-4788-a138-068eb05855ae service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:28.270319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee013b-5dac-4788-a138-068eb05855ae service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:28.270586 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee013b-5dac-4788-a138-068eb05855ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:28.279604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee013b-5dac-4788-a138-068eb05855ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:28.281251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee013b-5dac-4788-a138-068eb05855ae service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:28.289574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1294/2576] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:18:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:18:32.693110 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eca2b-170c-4709-95a2-8a805b1ae6c4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:32.695000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1e3eca2b-170c-4709-95a2-8a805b1ae6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:32.715355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eca2b-170c-4709-95a2-8a805b1ae6c4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:32.721808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a102c-2c3e-420b-aad4-91c2d9e4cd99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:32.722694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a102c-2c3e-420b-aad4-91c2d9e4cd99 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:32.723074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a102c-2c3e-420b-aad4-91c2d9e4cd99 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:32.723533 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a102c-2c3e-420b-aad4-91c2d9e4cd99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:32.726085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b90a102c-2c3e-420b-aad4-91c2d9e4cd99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:32.742876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a102c-2c3e-420b-aad4-91c2d9e4cd99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:32.744499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a102c-2c3e-420b-aad4-91c2d9e4cd99 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:32.759915 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1283/2577] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:38.008399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee013b-5dac-4788-a138-068eb05855ae service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:38.010114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d0ee013b-5dac-4788-a138-068eb05855ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:38.026561 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:38.079652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee013b-5dac-4788-a138-068eb05855ae service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:38.086123 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa96c7-dd41-4b28-b65b-b2944d0a8aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:38.087057 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa96c7-dd41-4b28-b65b-b2944d0a8aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:38.087413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa96c7-dd41-4b28-b65b-b2944d0a8aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:38.087768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa96c7-dd41-4b28-b65b-b2944d0a8aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:38.090621 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-76aa96c7-dd41-4b28-b65b-b2944d0a8aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:38.165129 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa96c7-dd41-4b28-b65b-b2944d0a8aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:38.166604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa96c7-dd41-4b28-b65b-b2944d0a8aa0 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:38.177678 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1295/2578] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:41.349616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a102c-2c3e-420b-aad4-91c2d9e4cd99 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:41.351068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b90a102c-2c3e-420b-aad4-91c2d9e4cd99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:41.365156 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a102c-2c3e-420b-aad4-91c2d9e4cd99 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:41.369596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:41.370593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:41.370872 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:41.371143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] PATH_INFO: `/v3/users/d770c98d01ea4c9bb20b79dab4bfc0ad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:41.372326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d770c98d01ea4c9bb20b79dab4bfc0ad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:41.374295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:41.426653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd770c98d01ea4c9bb20b79dab4bfc0ad'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:41.433908 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd770c98d01ea4c9bb20b79dab4bfc0ad'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:41.434586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd770c98d01ea4c9bb20b79dab4bfc0ad'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:41.444505 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd770c98d01ea4c9bb20b79dab4bfc0ad'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:41.458220 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62bf0070-fdf1-4560-8f4b-f6ab591093bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd770c98d01ea4c9bb20b79dab4bfc0ad'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:41.464779 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1284/2579] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:18:41 2022] DELETE /identity/v3/users/d770c98d01ea4c9bb20b79dab4bfc0ad => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:41.654917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa96c7-dd41-4b28-b65b-b2944d0a8aa0 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:41.665911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa96c7-dd41-4b28-b65b-b2944d0a8aa0 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:41.737450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:41.738487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:41.738765 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:41.739043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] PATH_INFO: `/v3/projects/2eea96762b8a42338e8b6fd2c501b43e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:41.740226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eea96762b8a42338e8b6fd2c501b43e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:41.742186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:41.795189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eea96762b8a42338e8b6fd2c501b43e', 'request_id': 'req-066c2bab-43da-4535-988d-eaaf8c531ad7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:41.801688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eea96762b8a42338e8b6fd2c501b43e', 'request_id': 'req-066c2bab-43da-4535-988d-eaaf8c531ad7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:41.813035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eea96762b8a42338e8b6fd2c501b43e', 'request_id': 'req-066c2bab-43da-4535-988d-eaaf8c531ad7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:41.817898 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:41.826703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] The token cache is being invalidate because project 2eea96762b8a42338e8b6fd2c501b43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:18:41.827150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:41.828109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-066c2bab-43da-4535-988d-eaaf8c531ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:41.830049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1296/2580] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:18:41 2022] DELETE /identity/v3/projects/2eea96762b8a42338e8b6fd2c501b43e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:41.835206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488a5ac-047c-4a63-a136-2a36cc36fa03 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:41.835493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488a5ac-047c-4a63-a136-2a36cc36fa03 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:41.835773 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488a5ac-047c-4a63-a136-2a36cc36fa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:41.854688 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d488a5ac-047c-4a63-a136-2a36cc36fa03 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:41.855899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d488a5ac-047c-4a63-a136-2a36cc36fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:41.922577 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1285/2581] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:41.931088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0cdf8-dee4-45bf-bdb7-2a3ef5f938f4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:41.931379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0cdf8-dee4-45bf-bdb7-2a3ef5f938f4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:41.931654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0cdf8-dee4-45bf-bdb7-2a3ef5f938f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:41.950377 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4eb0cdf8-dee4-45bf-bdb7-2a3ef5f938f4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:41.951582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4eb0cdf8-dee4-45bf-bdb7-2a3ef5f938f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:41.959737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1297/2582] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:41.964002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488a5ac-047c-4a63-a136-2a36cc36fa03 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:41.970837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:41.975132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488a5ac-047c-4a63-a136-2a36cc36fa03 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:41.982029 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb069f-e11a-42e4-9aa3-63cde8888d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:41.982722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb069f-e11a-42e4-9aa3-63cde8888d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:41.983247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb069f-e11a-42e4-9aa3-63cde8888d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:41.983605 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb069f-e11a-42e4-9aa3-63cde8888d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:41.984556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb069f-e11a-42e4-9aa3-63cde8888d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:18:41.985169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb069f-e11a-42e4-9aa3-63cde8888d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:41.986824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb069f-e11a-42e4-9aa3-63cde8888d98 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:41.998979 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1286/2583] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:18:42.007413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0cdf8-dee4-45bf-bdb7-2a3ef5f938f4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.019923 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0cdf8-dee4-45bf-bdb7-2a3ef5f938f4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.027883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf5f21-4d76-4d11-b65d-96fc7decbb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.028799 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5f21-4d76-4d11-b65d-96fc7decbb74 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.029104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5f21-4d76-4d11-b65d-96fc7decbb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.029483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5f21-4d76-4d11-b65d-96fc7decbb74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.030533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf5f21-4d76-4d11-b65d-96fc7decbb74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.032941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf5f21-4d76-4d11-b65d-96fc7decbb74 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.071164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1298/2584] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:18:42 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:42.076579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb069f-e11a-42e4-9aa3-63cde8888d98 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.087552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb069f-e11a-42e4-9aa3-63cde8888d98 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.150100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924c70-7171-4a3f-9182-708154a0dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.151053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924c70-7171-4a3f-9182-708154a0dd07 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.151443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924c70-7171-4a3f-9182-708154a0dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.151860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924c70-7171-4a3f-9182-708154a0dd07 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.152894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07924c70-7171-4a3f-9182-708154a0dd07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.155707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07924c70-7171-4a3f-9182-708154a0dd07 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.186282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1287/2585] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:18:42 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:42.190725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf5f21-4d76-4d11-b65d-96fc7decbb74 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.202174 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf5f21-4d76-4d11-b65d-96fc7decbb74 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.207997 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bdbac-9dde-4355-94b2-3fa8bfabb109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.208808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bdbac-9dde-4355-94b2-3fa8bfabb109 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.209082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bdbac-9dde-4355-94b2-3fa8bfabb109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.209368 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bdbac-9dde-4355-94b2-3fa8bfabb109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.210097 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bdbac-9dde-4355-94b2-3fa8bfabb109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.211687 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bdbac-9dde-4355-94b2-3fa8bfabb109 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.222176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1299/2586] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:42.226259 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924c70-7171-4a3f-9182-708154a0dd07 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.236728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924c70-7171-4a3f-9182-708154a0dd07 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.242312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba025d6-a475-4588-9591-7f95e610f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.242938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba025d6-a475-4588-9591-7f95e610f384 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.243217 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba025d6-a475-4588-9591-7f95e610f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.243488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba025d6-a475-4588-9591-7f95e610f384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.244207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba025d6-a475-4588-9591-7f95e610f384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.245855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba025d6-a475-4588-9591-7f95e610f384 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.256437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1288/2587] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:42.260613 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bdbac-9dde-4355-94b2-3fa8bfabb109 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.271250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bdbac-9dde-4355-94b2-3fa8bfabb109 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.276781 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b6fbd-be05-43a8-a547-79be0bd2caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.277696 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b6fbd-be05-43a8-a547-79be0bd2caae admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.277974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b6fbd-be05-43a8-a547-79be0bd2caae admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.278245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b6fbd-be05-43a8-a547-79be0bd2caae admin admin] PATH_INFO: `/v3/projects/495de7fe0280487bb2c20386b3276d2f/users/e728a9c660d94bba87d92c11b49e321f/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.292956 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b6fbd-be05-43a8-a547-79be0bd2caae admin admin] RBAC: Authorizing `identity:create_grant(project_id=495de7fe0280487bb2c20386b3276d2f, user_id=e728a9c660d94bba87d92c11b49e321f, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.295637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b6fbd-be05-43a8-a547-79be0bd2caae admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.310396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1300/2588] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:42 2022] PUT /identity/v3/projects/495de7fe0280487bb2c20386b3276d2f/users/e728a9c660d94bba87d92c11b49e321f/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:42.321286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c4cf1-1891-4100-aaf4-42757ac15e14 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.321286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c4cf1-1891-4100-aaf4-42757ac15e14 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.321543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c4cf1-1891-4100-aaf4-42757ac15e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.352603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e11c4cf1-1891-4100-aaf4-42757ac15e14 None None] MFA Rules not processed for user `e728a9c660d94bba87d92c11b49e321f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:42.353855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e11c4cf1-1891-4100-aaf4-42757ac15e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:42.425465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1289/2589] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:42.430176 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b6fbd-be05-43a8-a547-79be0bd2caae admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.495822 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b6fbd-be05-43a8-a547-79be0bd2caae admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.502231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327fa97-317b-48f2-a5eb-3826745a8a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.502891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327fa97-317b-48f2-a5eb-3826745a8a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.503165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327fa97-317b-48f2-a5eb-3826745a8a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.503433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327fa97-317b-48f2-a5eb-3826745a8a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.504113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327fa97-317b-48f2-a5eb-3826745a8a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.506051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327fa97-317b-48f2-a5eb-3826745a8a4b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.535196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1301/2590] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:18:42 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:42.541105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c4cf1-1891-4100-aaf4-42757ac15e14 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.551989 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c4cf1-1891-4100-aaf4-42757ac15e14 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.610528 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c504-a0b1-4a1e-ac63-c27c2de3ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.611122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c504-a0b1-4a1e-ac63-c27c2de3ef26 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.611425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c504-a0b1-4a1e-ac63-c27c2de3ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.611692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c504-a0b1-4a1e-ac63-c27c2de3ef26 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.612367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591c504-a0b1-4a1e-ac63-c27c2de3ef26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.614352 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591c504-a0b1-4a1e-ac63-c27c2de3ef26 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.620921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:42.638769 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1290/2591] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:18:42 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:42.642828 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327fa97-317b-48f2-a5eb-3826745a8a4b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.653603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327fa97-317b-48f2-a5eb-3826745a8a4b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.659159 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370962-e370-4c2e-813d-aaecb4d07193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.659821 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370962-e370-4c2e-813d-aaecb4d07193 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.660101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370962-e370-4c2e-813d-aaecb4d07193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.660373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370962-e370-4c2e-813d-aaecb4d07193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.661100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370962-e370-4c2e-813d-aaecb4d07193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.662832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370962-e370-4c2e-813d-aaecb4d07193 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.673979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1302/2592] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:42.678784 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c504-a0b1-4a1e-ac63-c27c2de3ef26 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.693310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c504-a0b1-4a1e-ac63-c27c2de3ef26 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.699478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3c4e0-c5e0-4d03-a781-3995bf917a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.700359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3c4e0-c5e0-4d03-a781-3995bf917a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.700635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3c4e0-c5e0-4d03-a781-3995bf917a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.700898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3c4e0-c5e0-4d03-a781-3995bf917a23 admin admin] PATH_INFO: `/v3/projects/a719954f04ee4f8abae1c86fb343cff9/users/9543160acc8748318260fc3f8d90bb98/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.717422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3c4e0-c5e0-4d03-a781-3995bf917a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a719954f04ee4f8abae1c86fb343cff9, user_id=9543160acc8748318260fc3f8d90bb98, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.720183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3c4e0-c5e0-4d03-a781-3995bf917a23 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.736054 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1291/2593] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:42 2022] PUT /identity/v3/projects/a719954f04ee4f8abae1c86fb343cff9/users/9543160acc8748318260fc3f8d90bb98/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:42.740085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370962-e370-4c2e-813d-aaecb4d07193 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.750226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370962-e370-4c2e-813d-aaecb4d07193 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.802055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:42.811312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19ddc0-0023-4dbe-94e9-bf0e1647f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.811986 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19ddc0-0023-4dbe-94e9-bf0e1647f666 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.812319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19ddc0-0023-4dbe-94e9-bf0e1647f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.812617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19ddc0-0023-4dbe-94e9-bf0e1647f666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.813439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19ddc0-0023-4dbe-94e9-bf0e1647f666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.815142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19ddc0-0023-4dbe-94e9-bf0e1647f666 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.825581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1303/2594] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:42.830216 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3c4e0-c5e0-4d03-a781-3995bf917a23 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.841059 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3c4e0-c5e0-4d03-a781-3995bf917a23 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:42.846415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e7b8-f863-4e93-8f42-2ea5c000c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:42.847300 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e7b8-f863-4e93-8f42-2ea5c000c944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.847576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e7b8-f863-4e93-8f42-2ea5c000c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.847832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e7b8-f863-4e93-8f42-2ea5c000c944 admin admin] PATH_INFO: `/v3/projects/a719954f04ee4f8abae1c86fb343cff9/users/9543160acc8748318260fc3f8d90bb98/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.849876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0e7b8-f863-4e93-8f42-2ea5c000c944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a719954f04ee4f8abae1c86fb343cff9, user_id=9543160acc8748318260fc3f8d90bb98, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:42.852523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0e7b8-f863-4e93-8f42-2ea5c000c944 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:42.864481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1292/2595] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:42 2022] PUT /identity/v3/projects/a719954f04ee4f8abae1c86fb343cff9/users/9543160acc8748318260fc3f8d90bb98/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:42.874726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cd782-0c42-4383-920e-cd9e1141f205 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:42.875009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cd782-0c42-4383-920e-cd9e1141f205 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:42.875283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cd782-0c42-4383-920e-cd9e1141f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:42.903327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-353cd782-0c42-4383-920e-cd9e1141f205 None None] MFA Rules not processed for user `9543160acc8748318260fc3f8d90bb98`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:42.904565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-353cd782-0c42-4383-920e-cd9e1141f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:42.975365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1304/2596] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:42.987468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e7b8-f863-4e93-8f42-2ea5c000c944 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:42.989372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-28c0e7b8-f863-4e93-8f42-2ea5c000c944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:43.055970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e7b8-f863-4e93-8f42-2ea5c000c944 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:43.060026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbd270-a9bc-41d1-b4e8-ec29e7ed72a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:43.060658 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbd270-a9bc-41d1-b4e8-ec29e7ed72a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:43.060937 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbd270-a9bc-41d1-b4e8-ec29e7ed72a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:43.061241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbd270-a9bc-41d1-b4e8-ec29e7ed72a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:43.070987 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbd270-a9bc-41d1-b4e8-ec29e7ed72a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:43.072425 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbd270-a9bc-41d1-b4e8-ec29e7ed72a1 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:43.082362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1293/2597] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:43.515409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cd782-0c42-4383-920e-cd9e1141f205 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:43.578200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cd782-0c42-4383-920e-cd9e1141f205 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:43.583323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:43.584199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:43.584483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:43.584756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] PATH_INFO: `/v3/users/e728a9c660d94bba87d92c11b49e321f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:43.585959 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e728a9c660d94bba87d92c11b49e321f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:43.587875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:43.643223 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e728a9c660d94bba87d92c11b49e321f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:43.649859 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e728a9c660d94bba87d92c11b49e321f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:43.650517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e728a9c660d94bba87d92c11b49e321f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:43.659864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e728a9c660d94bba87d92c11b49e321f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:43.660573 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e728a9c660d94bba87d92c11b49e321f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:43.672136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:43.680944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1305/2598] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:18:43 2022] DELETE /identity/v3/users/e728a9c660d94bba87d92c11b49e321f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:43.685851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0295407-adef-473e-8181-760008a6895a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:43.686318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0295407-adef-473e-8181-760008a6895a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:43.686435 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0295407-adef-473e-8181-760008a6895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:43.705236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d0295407-adef-473e-8181-760008a6895a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:43.707489 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d0295407-adef-473e-8181-760008a6895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:43.777236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1294/2599] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:43.789309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:43.790877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:43.852639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1f99f-5b0d-4a36-b9dd-654577a97b59 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:43.856788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc15af-7ab0-4800-b22e-3ca889a3c205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:43.857457 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc15af-7ab0-4800-b22e-3ca889a3c205 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:43.857739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc15af-7ab0-4800-b22e-3ca889a3c205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:43.858016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc15af-7ab0-4800-b22e-3ca889a3c205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:43.870140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc15af-7ab0-4800-b22e-3ca889a3c205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:43.871582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc15af-7ab0-4800-b22e-3ca889a3c205 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:43.881887 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1306/2600] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:44.175231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0295407-adef-473e-8181-760008a6895a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:44.176699 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d0295407-adef-473e-8181-760008a6895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:44.191808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0295407-adef-473e-8181-760008a6895a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:44.199061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:44.200116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:44.200572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:44.200963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] PATH_INFO: `/v3/projects/495de7fe0280487bb2c20386b3276d2f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:44.202603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=495de7fe0280487bb2c20386b3276d2f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:44.205034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:44.255945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495de7fe0280487bb2c20386b3276d2f', 'request_id': 'req-e70de7b2-d773-4efa-a458-bb904a3f91cd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.257033 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:44.264134 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495de7fe0280487bb2c20386b3276d2f', 'request_id': 'req-e70de7b2-d773-4efa-a458-bb904a3f91cd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.274115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495de7fe0280487bb2c20386b3276d2f', 'request_id': 'req-e70de7b2-d773-4efa-a458-bb904a3f91cd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.285426 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] The token cache is being invalidate because project 495de7fe0280487bb2c20386b3276d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:18:44.285742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.286518 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.288120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1295/2601] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:18:44 2022] DELETE /identity/v3/projects/495de7fe0280487bb2c20386b3276d2f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:44.292238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc15af-7ab0-4800-b22e-3ca889a3c205 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:44.302572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc15af-7ab0-4800-b22e-3ca889a3c205 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:44.363796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:44.364659 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:44.364936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:44.365232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] PATH_INFO: `/v3/users/9543160acc8748318260fc3f8d90bb98` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:44.366544 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9543160acc8748318260fc3f8d90bb98)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:44.368488 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:44.426490 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9543160acc8748318260fc3f8d90bb98'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.433168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9543160acc8748318260fc3f8d90bb98'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.433869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9543160acc8748318260fc3f8d90bb98'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.443546 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9543160acc8748318260fc3f8d90bb98'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.444183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2c39a046-0cfb-49f8-a111-96620930f248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9543160acc8748318260fc3f8d90bb98'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.463021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1307/2602] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:18:44 2022] DELETE /identity/v3/users/9543160acc8748318260fc3f8d90bb98 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:44.758096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:44.759820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:44.773745 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70de7b2-d773-4efa-a458-bb904a3f91cd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:44.830718 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:44.831586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:44.831859 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:44.832132 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] PATH_INFO: `/v3/projects/a719954f04ee4f8abae1c86fb343cff9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:44.833329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a719954f04ee4f8abae1c86fb343cff9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:44.835244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:44.882183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a719954f04ee4f8abae1c86fb343cff9', 'request_id': 'req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.888159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a719954f04ee4f8abae1c86fb343cff9', 'request_id': 'req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.898701 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a719954f04ee4f8abae1c86fb343cff9', 'request_id': 'req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.909392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] The token cache is being invalidate because project a719954f04ee4f8abae1c86fb343cff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:18:44.909679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.910328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e471eafa-688a-4b3d-95a7-1c8a68edc4f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:18:44.911917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1296/2603] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:18:44 2022] DELETE /identity/v3/projects/a719954f04ee4f8abae1c86fb343cff9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:44.918933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4b2a2-3fb5-46c9-b5c9-1adb188bde47 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:44.919431 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4b2a2-3fb5-46c9-b5c9-1adb188bde47 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:44.919544 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4b2a2-3fb5-46c9-b5c9-1adb188bde47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:44.938146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0ad4b2a2-3fb5-46c9-b5c9-1adb188bde47 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:44.939369 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0ad4b2a2-3fb5-46c9-b5c9-1adb188bde47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:44.952119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:45.001158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1308/2604] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:45.009123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6bd70-699f-4713-98d5-36f9a3effd39 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.009443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6bd70-699f-4713-98d5-36f9a3effd39 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.009723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6bd70-699f-4713-98d5-36f9a3effd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.030620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f8b6bd70-699f-4713-98d5-36f9a3effd39 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:45.031803 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f8b6bd70-699f-4713-98d5-36f9a3effd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:45.040593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1297/2605] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:45.044851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4b2a2-3fb5-46c9-b5c9-1adb188bde47 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.055033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4b2a2-3fb5-46c9-b5c9-1adb188bde47 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.059990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd8214-22bc-4153-97a4-f93ac7947b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.060638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8214-22bc-4153-97a4-f93ac7947b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.060922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8214-22bc-4153-97a4-f93ac7947b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.061193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8214-22bc-4153-97a4-f93ac7947b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.061951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd8214-22bc-4153-97a4-f93ac7947b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:18:45.062252 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd8214-22bc-4153-97a4-f93ac7947b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.063847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd8214-22bc-4153-97a4-f93ac7947b63 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.075690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1309/2606] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:18:45.080237 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6bd70-699f-4713-98d5-36f9a3effd39 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.089588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6bd70-699f-4713-98d5-36f9a3effd39 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.094338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71100c-a023-4d95-96cd-0b6b38692da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.094975 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71100c-a023-4d95-96cd-0b6b38692da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.095321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71100c-a023-4d95-96cd-0b6b38692da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.095613 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71100c-a023-4d95-96cd-0b6b38692da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.096292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71100c-a023-4d95-96cd-0b6b38692da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.098238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71100c-a023-4d95-96cd-0b6b38692da5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.127938 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1298/2607] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:18:45 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:45.132848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd8214-22bc-4153-97a4-f93ac7947b63 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.146928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd8214-22bc-4153-97a4-f93ac7947b63 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.205671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94a801-4a37-47ad-8c9e-31bd01be4f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.206276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94a801-4a37-47ad-8c9e-31bd01be4f74 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.206532 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94a801-4a37-47ad-8c9e-31bd01be4f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.206804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94a801-4a37-47ad-8c9e-31bd01be4f74 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.207486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94a801-4a37-47ad-8c9e-31bd01be4f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.209437 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94a801-4a37-47ad-8c9e-31bd01be4f74 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.232244 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1310/2608] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:18:45 2022] POST /identity/v3/users => generated 279 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:45.237187 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71100c-a023-4d95-96cd-0b6b38692da5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.247910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71100c-a023-4d95-96cd-0b6b38692da5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.254447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb674a-260b-483e-a3f1-5d327a9fa133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.255105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb674a-260b-483e-a3f1-5d327a9fa133 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.255365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb674a-260b-483e-a3f1-5d327a9fa133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.255629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb674a-260b-483e-a3f1-5d327a9fa133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.256349 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb674a-260b-483e-a3f1-5d327a9fa133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.257993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb674a-260b-483e-a3f1-5d327a9fa133 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.268822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1299/2609] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:45.274348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94a801-4a37-47ad-8c9e-31bd01be4f74 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.289508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94a801-4a37-47ad-8c9e-31bd01be4f74 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.296044 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa851ed-9c11-4a1b-8095-b5bb796ff268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.296975 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa851ed-9c11-4a1b-8095-b5bb796ff268 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.297271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa851ed-9c11-4a1b-8095-b5bb796ff268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.297569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa851ed-9c11-4a1b-8095-b5bb796ff268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.298682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa851ed-9c11-4a1b-8095-b5bb796ff268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.300458 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa851ed-9c11-4a1b-8095-b5bb796ff268 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.310624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1311/2610] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:45.314941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb674a-260b-483e-a3f1-5d327a9fa133 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.326879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb674a-260b-483e-a3f1-5d327a9fa133 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.332081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b3cb-5ed8-4284-803e-c3970301eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.332988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b3cb-5ed8-4284-803e-c3970301eb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.333296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b3cb-5ed8-4284-803e-c3970301eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.333567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b3cb-5ed8-4284-803e-c3970301eb14 admin admin] PATH_INFO: `/v3/projects/1c89fc9efe684a4a9cdd59389ca4c517/users/1d05f9024e34472aa3a2a059366977c1/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.348795 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9b3cb-5ed8-4284-803e-c3970301eb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c89fc9efe684a4a9cdd59389ca4c517, user_id=1d05f9024e34472aa3a2a059366977c1, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.351617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9b3cb-5ed8-4284-803e-c3970301eb14 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.366645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1300/2611] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:45 2022] PUT /identity/v3/projects/1c89fc9efe684a4a9cdd59389ca4c517/users/1d05f9024e34472aa3a2a059366977c1/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:45.377556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f29a2-b6b6-41e7-a936-d887f59715e2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.377843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f29a2-b6b6-41e7-a936-d887f59715e2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.378103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f29a2-b6b6-41e7-a936-d887f59715e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.406959 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5e6f29a2-b6b6-41e7-a936-d887f59715e2 None None] MFA Rules not processed for user `1d05f9024e34472aa3a2a059366977c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:45.408297 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5e6f29a2-b6b6-41e7-a936-d887f59715e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:45.475191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1312/2612] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:45 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:45.481227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b3cb-5ed8-4284-803e-c3970301eb14 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.487763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:45.546201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b3cb-5ed8-4284-803e-c3970301eb14 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.551434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2cd6f-f655-4eb5-b1a2-85e5e807d010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.552096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2cd6f-f655-4eb5-b1a2-85e5e807d010 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.552385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2cd6f-f655-4eb5-b1a2-85e5e807d010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.552763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2cd6f-f655-4eb5-b1a2-85e5e807d010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.553485 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2cd6f-f655-4eb5-b1a2-85e5e807d010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.555410 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2cd6f-f655-4eb5-b1a2-85e5e807d010 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.584583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1301/2613] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:18:45 2022] POST /identity/v3/projects => generated 353 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:18:45.588755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f29a2-b6b6-41e7-a936-d887f59715e2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.600352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f29a2-b6b6-41e7-a936-d887f59715e2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.609826 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:45.661630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebc146-5418-4faa-9a82-38dbb269d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.662352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc146-5418-4faa-9a82-38dbb269d187 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.662633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc146-5418-4faa-9a82-38dbb269d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.662929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc146-5418-4faa-9a82-38dbb269d187 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.663610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebc146-5418-4faa-9a82-38dbb269d187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.665639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebc146-5418-4faa-9a82-38dbb269d187 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.686633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1313/2614] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:18:45 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:18:45.692260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2cd6f-f655-4eb5-b1a2-85e5e807d010 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.709724 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2cd6f-f655-4eb5-b1a2-85e5e807d010 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.717649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e459fb-f75e-4fc2-af4e-14a67e427045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.718913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e459fb-f75e-4fc2-af4e-14a67e427045 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.719304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e459fb-f75e-4fc2-af4e-14a67e427045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.719784 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e459fb-f75e-4fc2-af4e-14a67e427045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.720728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e459fb-f75e-4fc2-af4e-14a67e427045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.722407 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e459fb-f75e-4fc2-af4e-14a67e427045 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.733591 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1302/2615] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:45.738009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebc146-5418-4faa-9a82-38dbb269d187 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.748796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebc146-5418-4faa-9a82-38dbb269d187 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.754117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bfce1-6fc3-4709-b1ef-9325efcec030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.754979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bfce1-6fc3-4709-b1ef-9325efcec030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.755280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bfce1-6fc3-4709-b1ef-9325efcec030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.755565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bfce1-6fc3-4709-b1ef-9325efcec030 admin admin] PATH_INFO: `/v3/projects/3483be810b3b483c8d6abe3fcbaeded0/users/671c3423c0e24ddbbeff581c5a77efb0/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.770999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bfce1-6fc3-4709-b1ef-9325efcec030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3483be810b3b483c8d6abe3fcbaeded0, user_id=671c3423c0e24ddbbeff581c5a77efb0, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.773723 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bfce1-6fc3-4709-b1ef-9325efcec030 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.792587 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1314/2616] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:45 2022] PUT /identity/v3/projects/3483be810b3b483c8d6abe3fcbaeded0/users/671c3423c0e24ddbbeff581c5a77efb0/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:45.797055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e459fb-f75e-4fc2-af4e-14a67e427045 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.808472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e459fb-f75e-4fc2-af4e-14a67e427045 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.866492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069095e-0219-446d-8ade-f8e152725a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.867160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069095e-0219-446d-8ade-f8e152725a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.867446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069095e-0219-446d-8ade-f8e152725a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.867723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069095e-0219-446d-8ade-f8e152725a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.868444 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069095e-0219-446d-8ade-f8e152725a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.870084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069095e-0219-446d-8ade-f8e152725a40 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.880296 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1303/2617] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:18:45.886832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bfce1-6fc3-4709-b1ef-9325efcec030 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:45.900579 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bfce1-6fc3-4709-b1ef-9325efcec030 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:45.906508 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47a2fd-9a24-4886-a80b-e726c549225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:45.907398 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a2fd-9a24-4886-a80b-e726c549225b admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.907693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a2fd-9a24-4886-a80b-e726c549225b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.908078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a2fd-9a24-4886-a80b-e726c549225b admin admin] PATH_INFO: `/v3/projects/3483be810b3b483c8d6abe3fcbaeded0/users/671c3423c0e24ddbbeff581c5a77efb0/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.910633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47a2fd-9a24-4886-a80b-e726c549225b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3483be810b3b483c8d6abe3fcbaeded0, user_id=671c3423c0e24ddbbeff581c5a77efb0, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:45.913354 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47a2fd-9a24-4886-a80b-e726c549225b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:45.926987 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1315/2618] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:18:45 2022] PUT /identity/v3/projects/3483be810b3b483c8d6abe3fcbaeded0/users/671c3423c0e24ddbbeff581c5a77efb0/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:18:45.938356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc39b-6b32-4a46-a136-f76286bb0006 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:45.938651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc39b-6b32-4a46-a136-f76286bb0006 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:45.938931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc39b-6b32-4a46-a136-f76286bb0006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:45.968206 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1f7cc39b-6b32-4a46-a136-f76286bb0006 None None] MFA Rules not processed for user `671c3423c0e24ddbbeff581c5a77efb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:18:45.969459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f7cc39b-6b32-4a46-a136-f76286bb0006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:46.044928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:46.049231 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1304/2619] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:18:45 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:18:46.061986 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47a2fd-9a24-4886-a80b-e726c549225b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:46.064295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6e47a2fd-9a24-4886-a80b-e726c549225b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:18:46.124414 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47a2fd-9a24-4886-a80b-e726c549225b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:46.128543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6fceb-6c15-4e62-b2e7-28ac8db3edc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:46.129189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6fceb-6c15-4e62-b2e7-28ac8db3edc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:46.129500 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6fceb-6c15-4e62-b2e7-28ac8db3edc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:46.129769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6fceb-6c15-4e62-b2e7-28ac8db3edc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:46.139505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6fceb-6c15-4e62-b2e7-28ac8db3edc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:46.140946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6fceb-6c15-4e62-b2e7-28ac8db3edc5 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:46.150897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1316/2620] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:46 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:46.228679 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cc39b-6b32-4a46-a136-f76286bb0006 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:18:46.239707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cc39b-6b32-4a46-a136-f76286bb0006 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:18:46.244310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790b311-b02a-4bdd-9f17-fa09a3f2983e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:18:46.244954 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b311-b02a-4bdd-9f17-fa09a3f2983e service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:18:46.245274 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b311-b02a-4bdd-9f17-fa09a3f2983e service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:18:46.245551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b311-b02a-4bdd-9f17-fa09a3f2983e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:18:46.305408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790b311-b02a-4bdd-9f17-fa09a3f2983e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:18:46.307634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790b311-b02a-4bdd-9f17-fa09a3f2983e service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:18:46.321329 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1305/2621] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:18:46 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:18:56.146540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=64,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:56.315881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=28 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:01.385868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6fceb-6c15-4e62-b2e7-28ac8db3edc5 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:01.462183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6fceb-6c15-4e62-b2e7-28ac8db3edc5 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:01.468270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:01.469379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:01.469830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:01.470098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] PATH_INFO: `/v3/users/1d05f9024e34472aa3a2a059366977c1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:01.471635 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d05f9024e34472aa3a2a059366977c1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:01.474768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:01.531068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d05f9024e34472aa3a2a059366977c1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:01.541555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d05f9024e34472aa3a2a059366977c1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:01.542333 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d05f9024e34472aa3a2a059366977c1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:01.551970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d05f9024e34472aa3a2a059366977c1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:01.552658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d05f9024e34472aa3a2a059366977c1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:01.570487 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1317/2622] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:01 2022] DELETE /identity/v3/users/1d05f9024e34472aa3a2a059366977c1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:01.575729 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82df1-925e-4681-86d6-3e3fca1336e3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:01.576230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82df1-925e-4681-86d6-3e3fca1336e3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:01.576316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82df1-925e-4681-86d6-3e3fca1336e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:01.593695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-79f82df1-925e-4681-86d6-3e3fca1336e3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:01.594970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-79f82df1-925e-4681-86d6-3e3fca1336e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:01.658254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1306/2623] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:01.668908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:01.670631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:01.735937 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e376c-8efa-43ab-9b70-1d0c7f37a94a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:01.740102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e04e6-3d61-4659-9a06-7bf0a7e65a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:01.740755 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e04e6-3d61-4659-9a06-7bf0a7e65a07 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:01.741032 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e04e6-3d61-4659-9a06-7bf0a7e65a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:01.741328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e04e6-3d61-4659-9a06-7bf0a7e65a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:01.751461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e04e6-3d61-4659-9a06-7bf0a7e65a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:01.753046 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e04e6-3d61-4659-9a06-7bf0a7e65a07 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:01.763435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1318/2624] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:02.052267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82df1-925e-4681-86d6-3e3fca1336e3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:02.053863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-79f82df1-925e-4681-86d6-3e3fca1336e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:02.066216 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82df1-925e-4681-86d6-3e3fca1336e3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:02.070848 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:02.071815 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:02.072100 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:02.072372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] PATH_INFO: `/v3/projects/1c89fc9efe684a4a9cdd59389ca4c517` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:02.073961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c89fc9efe684a4a9cdd59389ca4c517)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:02.075892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:02.132107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c89fc9efe684a4a9cdd59389ca4c517', 'request_id': 'req-e8d03712-5051-46b4-851e-1881532aad77'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.144416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c89fc9efe684a4a9cdd59389ca4c517', 'request_id': 'req-e8d03712-5051-46b4-851e-1881532aad77'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.151164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c89fc9efe684a4a9cdd59389ca4c517', 'request_id': 'req-e8d03712-5051-46b4-851e-1881532aad77'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.163552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] The token cache is being invalidate because project 1c89fc9efe684a4a9cdd59389ca4c517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:02.163927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.164763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.166844 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1307/2625] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:02 2022] DELETE /identity/v3/projects/1c89fc9efe684a4a9cdd59389ca4c517 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:02.171160 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e04e6-3d61-4659-9a06-7bf0a7e65a07 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:02.181717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e04e6-3d61-4659-9a06-7bf0a7e65a07 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:02.204611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:02.250151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:02.251145 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:02.251544 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:02.251821 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] PATH_INFO: `/v3/users/671c3423c0e24ddbbeff581c5a77efb0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:02.253017 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=671c3423c0e24ddbbeff581c5a77efb0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:02.254962 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:02.306063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671c3423c0e24ddbbeff581c5a77efb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.313788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671c3423c0e24ddbbeff581c5a77efb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.314331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671c3423c0e24ddbbeff581c5a77efb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.330679 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671c3423c0e24ddbbeff581c5a77efb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.332676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e10064a0-9071-4d58-bdfc-eeedcd5c97a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671c3423c0e24ddbbeff581c5a77efb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.357748 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1319/2626] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:02 2022] DELETE /identity/v3/users/671c3423c0e24ddbbeff581c5a77efb0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:19:02.648062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:02.650194 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:02.666891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d03712-5051-46b4-851e-1881532aad77 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:02.731469 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:02.732354 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:02.732640 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:02.732911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] PATH_INFO: `/v3/projects/3483be810b3b483c8d6abe3fcbaeded0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:02.734270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3483be810b3b483c8d6abe3fcbaeded0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:02.736152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:02.770421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:02.795928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3483be810b3b483c8d6abe3fcbaeded0', 'request_id': 'req-bff0ccfd-6be6-4577-841a-e2d8f054e510'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.802714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3483be810b3b483c8d6abe3fcbaeded0', 'request_id': 'req-bff0ccfd-6be6-4577-841a-e2d8f054e510'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.812498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3483be810b3b483c8d6abe3fcbaeded0', 'request_id': 'req-bff0ccfd-6be6-4577-841a-e2d8f054e510'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.824564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] The token cache is being invalidate because project 3483be810b3b483c8d6abe3fcbaeded0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:02.824761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.825462 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bff0ccfd-6be6-4577-841a-e2d8f054e510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:02.827053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1308/2627] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:02 2022] DELETE /identity/v3/projects/3483be810b3b483c8d6abe3fcbaeded0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:02.831983 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602877ea-f7d1-4c6b-8dd1-fbd1583396de None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:02.832480 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602877ea-f7d1-4c6b-8dd1-fbd1583396de None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:02.832586 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602877ea-f7d1-4c6b-8dd1-fbd1583396de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:02.857146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-602877ea-f7d1-4c6b-8dd1-fbd1583396de None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:02.858399 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-602877ea-f7d1-4c6b-8dd1-fbd1583396de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:02.918385 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1320/2628] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:19:02.926405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902901-7ff5-40a2-99fa-9738d919b2a3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:02.926681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902901-7ff5-40a2-99fa-9738d919b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:02.926962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902901-7ff5-40a2-99fa-9738d919b2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:02.946544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4b902901-7ff5-40a2-99fa-9738d919b2a3 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:02.947776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b902901-7ff5-40a2-99fa-9738d919b2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:02.956716 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1309/2629] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:02.961609 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602877ea-f7d1-4c6b-8dd1-fbd1583396de None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:02.973019 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602877ea-f7d1-4c6b-8dd1-fbd1583396de None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:02.979238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de44921-85ed-45a4-ae76-48e925bfd10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:02.979914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de44921-85ed-45a4-ae76-48e925bfd10d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:02.980201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de44921-85ed-45a4-ae76-48e925bfd10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:02.980481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de44921-85ed-45a4-ae76-48e925bfd10d admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:02.981239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de44921-85ed-45a4-ae76-48e925bfd10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:19:02.981575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de44921-85ed-45a4-ae76-48e925bfd10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:02.983204 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de44921-85ed-45a4-ae76-48e925bfd10d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:02.997374 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1321/2630] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:19:03.001649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902901-7ff5-40a2-99fa-9738d919b2a3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.012525 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902901-7ff5-40a2-99fa-9738d919b2a3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.017515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff2560-77b1-4d7b-9d8b-55590c60998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.018281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff2560-77b1-4d7b-9d8b-55590c60998b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.018593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff2560-77b1-4d7b-9d8b-55590c60998b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.018930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff2560-77b1-4d7b-9d8b-55590c60998b admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.019702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff2560-77b1-4d7b-9d8b-55590c60998b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.021842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff2560-77b1-4d7b-9d8b-55590c60998b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.054585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1310/2631] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:19:03 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:03.058327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de44921-85ed-45a4-ae76-48e925bfd10d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.068608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de44921-85ed-45a4-ae76-48e925bfd10d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.096874 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:03.137267 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929091a-6359-4020-afad-8623565b577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.137919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929091a-6359-4020-afad-8623565b577f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.138240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929091a-6359-4020-afad-8623565b577f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.138459 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929091a-6359-4020-afad-8623565b577f admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.139148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929091a-6359-4020-afad-8623565b577f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.141150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929091a-6359-4020-afad-8623565b577f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.162880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1322/2632] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:19:03 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:03.167233 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff2560-77b1-4d7b-9d8b-55590c60998b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.177887 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff2560-77b1-4d7b-9d8b-55590c60998b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.183017 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60165712-5fe8-48b7-8ec2-ce6ac65355eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.183675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60165712-5fe8-48b7-8ec2-ce6ac65355eb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.183953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60165712-5fe8-48b7-8ec2-ce6ac65355eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.184226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60165712-5fe8-48b7-8ec2-ce6ac65355eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.184952 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60165712-5fe8-48b7-8ec2-ce6ac65355eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.186593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60165712-5fe8-48b7-8ec2-ce6ac65355eb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.197530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1311/2633] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:03.203967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929091a-6359-4020-afad-8623565b577f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.220142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929091a-6359-4020-afad-8623565b577f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.228142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e03ce-b808-4f75-ac4a-ed57a43b6ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.228808 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e03ce-b808-4f75-ac4a-ed57a43b6ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.229071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e03ce-b808-4f75-ac4a-ed57a43b6ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.229411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e03ce-b808-4f75-ac4a-ed57a43b6ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.230167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e03ce-b808-4f75-ac4a-ed57a43b6ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.231766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e03ce-b808-4f75-ac4a-ed57a43b6ab3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.242608 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1323/2634] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:03.247138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60165712-5fe8-48b7-8ec2-ce6ac65355eb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.257965 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60165712-5fe8-48b7-8ec2-ce6ac65355eb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.263653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49757f-eec0-4225-a9af-415753025107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.264555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49757f-eec0-4225-a9af-415753025107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.264833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49757f-eec0-4225-a9af-415753025107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.265105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49757f-eec0-4225-a9af-415753025107 admin admin] PATH_INFO: `/v3/projects/fed2e59d2b5b4e3fb591fa682bcb2f90/users/a95a05e6f7054ae1b5f4e5247b6b1781/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.280461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49757f-eec0-4225-a9af-415753025107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed2e59d2b5b4e3fb591fa682bcb2f90, user_id=a95a05e6f7054ae1b5f4e5247b6b1781, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.283235 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49757f-eec0-4225-a9af-415753025107 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.302742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1312/2635] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:03 2022] PUT /identity/v3/projects/fed2e59d2b5b4e3fb591fa682bcb2f90/users/a95a05e6f7054ae1b5f4e5247b6b1781/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:03.313474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881372b-5be0-45b4-9bd7-b71c5e2d753e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.313767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881372b-5be0-45b4-9bd7-b71c5e2d753e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.314071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881372b-5be0-45b4-9bd7-b71c5e2d753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.342461 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1881372b-5be0-45b4-9bd7-b71c5e2d753e None None] MFA Rules not processed for user `a95a05e6f7054ae1b5f4e5247b6b1781`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:03.343615 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1881372b-5be0-45b4-9bd7-b71c5e2d753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:03.412036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1324/2636] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:19:03.417049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49757f-eec0-4225-a9af-415753025107 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.482931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49757f-eec0-4225-a9af-415753025107 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.487898 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c835d-45d7-4695-8e2b-04401fe30f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.488555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c835d-45d7-4695-8e2b-04401fe30f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.488836 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c835d-45d7-4695-8e2b-04401fe30f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.489105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c835d-45d7-4695-8e2b-04401fe30f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.489852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c835d-45d7-4695-8e2b-04401fe30f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.491775 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c835d-45d7-4695-8e2b-04401fe30f55 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.519377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1313/2637] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:19:03 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:03.523787 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881372b-5be0-45b4-9bd7-b71c5e2d753e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.534912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881372b-5be0-45b4-9bd7-b71c5e2d753e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.603383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cf00d-4fba-4df6-b0aa-8c56211b1f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.603948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cf00d-4fba-4df6-b0aa-8c56211b1f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.604227 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cf00d-4fba-4df6-b0aa-8c56211b1f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.604501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cf00d-4fba-4df6-b0aa-8c56211b1f2a admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.605190 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cf00d-4fba-4df6-b0aa-8c56211b1f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.607142 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cf00d-4fba-4df6-b0aa-8c56211b1f2a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.628990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1325/2638] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:19:03 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:03.633532 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c835d-45d7-4695-8e2b-04401fe30f55 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.645166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c835d-45d7-4695-8e2b-04401fe30f55 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.650102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ebe24-ef37-41b1-b84c-a476dac9bf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.650763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebe24-ef37-41b1-b84c-a476dac9bf38 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.651044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebe24-ef37-41b1-b84c-a476dac9bf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.651322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebe24-ef37-41b1-b84c-a476dac9bf38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.652051 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ebe24-ef37-41b1-b84c-a476dac9bf38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.653774 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ebe24-ef37-41b1-b84c-a476dac9bf38 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.664391 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1314/2639] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:03.668917 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cf00d-4fba-4df6-b0aa-8c56211b1f2a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.679676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cf00d-4fba-4df6-b0aa-8c56211b1f2a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.685731 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39860b-8dd0-466b-8fe6-37094a59e5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.686619 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39860b-8dd0-466b-8fe6-37094a59e5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.686885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39860b-8dd0-466b-8fe6-37094a59e5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.687157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39860b-8dd0-466b-8fe6-37094a59e5cc admin admin] PATH_INFO: `/v3/projects/d837cb3c5f4642bebd97c873fbff0d3c/users/47fdb8851b2541d087797bcb76f4c9f2/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.703811 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39860b-8dd0-466b-8fe6-37094a59e5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d837cb3c5f4642bebd97c873fbff0d3c, user_id=47fdb8851b2541d087797bcb76f4c9f2, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.706583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39860b-8dd0-466b-8fe6-37094a59e5cc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.723651 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1326/2640] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:03 2022] PUT /identity/v3/projects/d837cb3c5f4642bebd97c873fbff0d3c/users/47fdb8851b2541d087797bcb76f4c9f2/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:03.728705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ebe24-ef37-41b1-b84c-a476dac9bf38 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.743878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ebe24-ef37-41b1-b84c-a476dac9bf38 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.763861 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:03.804180 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdddf2-6bca-4ad8-9cbb-0f7849798a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.804860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdddf2-6bca-4ad8-9cbb-0f7849798a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.805150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdddf2-6bca-4ad8-9cbb-0f7849798a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.805461 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdddf2-6bca-4ad8-9cbb-0f7849798a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.806324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdddf2-6bca-4ad8-9cbb-0f7849798a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.807931 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdddf2-6bca-4ad8-9cbb-0f7849798a80 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.819165 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1315/2641] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:03.823954 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39860b-8dd0-466b-8fe6-37094a59e5cc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:03.829513 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:03.835136 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39860b-8dd0-466b-8fe6-37094a59e5cc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:03.841625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b68ad-c247-4deb-a73d-bed40eaa2383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:03.842536 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b68ad-c247-4deb-a73d-bed40eaa2383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.842817 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b68ad-c247-4deb-a73d-bed40eaa2383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.843091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b68ad-c247-4deb-a73d-bed40eaa2383 admin admin] PATH_INFO: `/v3/projects/d837cb3c5f4642bebd97c873fbff0d3c/users/47fdb8851b2541d087797bcb76f4c9f2/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.845360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b68ad-c247-4deb-a73d-bed40eaa2383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d837cb3c5f4642bebd97c873fbff0d3c, user_id=47fdb8851b2541d087797bcb76f4c9f2, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:03.848010 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b68ad-c247-4deb-a73d-bed40eaa2383 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:03.859840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1327/2642] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:03 2022] PUT /identity/v3/projects/d837cb3c5f4642bebd97c873fbff0d3c/users/47fdb8851b2541d087797bcb76f4c9f2/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:03.873491 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e9813-769c-48a8-a8f6-cf8bb5ff6f0f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:03.873780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e9813-769c-48a8-a8f6-cf8bb5ff6f0f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:03.874054 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e9813-769c-48a8-a8f6-cf8bb5ff6f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:03.908421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3c7e9813-769c-48a8-a8f6-cf8bb5ff6f0f None None] MFA Rules not processed for user `47fdb8851b2541d087797bcb76f4c9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:03.909674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3c7e9813-769c-48a8-a8f6-cf8bb5ff6f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:03.985356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1316/2643] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:03 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:03.999995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b68ad-c247-4deb-a73d-bed40eaa2383 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:04.002992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d67b68ad-c247-4deb-a73d-bed40eaa2383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:04.069779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b68ad-c247-4deb-a73d-bed40eaa2383 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:04.074636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e853ea-0f33-4afd-8427-cc9a2941a46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:04.075274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e853ea-0f33-4afd-8427-cc9a2941a46e service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:04.075569 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e853ea-0f33-4afd-8427-cc9a2941a46e service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:04.075852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e853ea-0f33-4afd-8427-cc9a2941a46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:04.085471 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e853ea-0f33-4afd-8427-cc9a2941a46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:04.086918 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e853ea-0f33-4afd-8427-cc9a2941a46e service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:04.096620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1328/2644] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:05.535315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e9813-769c-48a8-a8f6-cf8bb5ff6f0f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:05.601846 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e9813-769c-48a8-a8f6-cf8bb5ff6f0f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:05.607917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:05.608911 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:05.609190 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:05.609488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] PATH_INFO: `/v3/users/a95a05e6f7054ae1b5f4e5247b6b1781` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:05.610685 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95a05e6f7054ae1b5f4e5247b6b1781)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:05.612588 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:05.666831 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e853ea-0f33-4afd-8427-cc9a2941a46e service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:05.668819 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-96e853ea-0f33-4afd-8427-cc9a2941a46e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:05.675032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95a05e6f7054ae1b5f4e5247b6b1781'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:05.676555 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:05.684424 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95a05e6f7054ae1b5f4e5247b6b1781'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:05.685146 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95a05e6f7054ae1b5f4e5247b6b1781'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:05.695152 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95a05e6f7054ae1b5f4e5247b6b1781'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:05.708572 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e0cddd19-e420-4486-8b89-b71c8d1546b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95a05e6f7054ae1b5f4e5247b6b1781'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:05.718825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1317/2645] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:05 2022] DELETE /identity/v3/users/a95a05e6f7054ae1b5f4e5247b6b1781 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:05.723137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48505479-8a61-4aa2-8e07-b81028630fd7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:05.723648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48505479-8a61-4aa2-8e07-b81028630fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:05.724131 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48505479-8a61-4aa2-8e07-b81028630fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:05.739226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e853ea-0f33-4afd-8427-cc9a2941a46e service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:05.746404 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-48505479-8a61-4aa2-8e07-b81028630fd7 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:05.748028 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-48505479-8a61-4aa2-8e07-b81028630fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:05.800202 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce70dd-584b-4033-a597-47c9739cdd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:05.800958 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce70dd-584b-4033-a597-47c9739cdd94 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:05.801456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce70dd-584b-4033-a597-47c9739cdd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:05.801903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce70dd-584b-4033-a597-47c9739cdd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:05.804268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9bce70dd-584b-4033-a597-47c9739cdd94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:05.819544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1318/2646] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:19:05.829691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48505479-8a61-4aa2-8e07-b81028630fd7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:05.831151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-48505479-8a61-4aa2-8e07-b81028630fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:05.844414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48505479-8a61-4aa2-8e07-b81028630fd7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:05.848215 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4b4eb-6c95-4b89-b9f5-e95fd1da014e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:05.848860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4b4eb-6c95-4b89-b9f5-e95fd1da014e service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:05.849138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4b4eb-6c95-4b89-b9f5-e95fd1da014e service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:05.849443 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4b4eb-6c95-4b89-b9f5-e95fd1da014e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:05.859331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4b4eb-6c95-4b89-b9f5-e95fd1da014e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:05.860858 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4b4eb-6c95-4b89-b9f5-e95fd1da014e service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:05.870953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1319/2647] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:19:05.879734 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce70dd-584b-4033-a597-47c9739cdd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:05.881168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce70dd-584b-4033-a597-47c9739cdd94 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:05.885439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:05.892344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1329/2648] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:06.170487 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4b4eb-6c95-4b89-b9f5-e95fd1da014e service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:06.172482 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6ce4b4eb-6c95-4b89-b9f5-e95fd1da014e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:06.201414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4b4eb-6c95-4b89-b9f5-e95fd1da014e service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:06.206619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:06.207517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:06.207793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:06.208064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] PATH_INFO: `/v3/projects/fed2e59d2b5b4e3fb591fa682bcb2f90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:06.209324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed2e59d2b5b4e3fb591fa682bcb2f90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:06.211289 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:06.262619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed2e59d2b5b4e3fb591fa682bcb2f90', 'request_id': 'req-37252fe1-4581-47ad-b84c-bb4122834ec6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.269180 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed2e59d2b5b4e3fb591fa682bcb2f90', 'request_id': 'req-37252fe1-4581-47ad-b84c-bb4122834ec6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.278334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed2e59d2b5b4e3fb591fa682bcb2f90', 'request_id': 'req-37252fe1-4581-47ad-b84c-bb4122834ec6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.289546 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] The token cache is being invalidate because project fed2e59d2b5b4e3fb591fa682bcb2f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:06.289819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.290594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.292815 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1320/2649] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:06 2022] DELETE /identity/v3/projects/fed2e59d2b5b4e3fb591fa682bcb2f90 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:06.297005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce70dd-584b-4033-a597-47c9739cdd94 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:06.308060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce70dd-584b-4033-a597-47c9739cdd94 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:06.371182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:06.372090 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:06.372370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:06.372644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] PATH_INFO: `/v3/users/47fdb8851b2541d087797bcb76f4c9f2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:06.373914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47fdb8851b2541d087797bcb76f4c9f2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:06.375878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:06.427323 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47fdb8851b2541d087797bcb76f4c9f2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.434880 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47fdb8851b2541d087797bcb76f4c9f2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.435616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47fdb8851b2541d087797bcb76f4c9f2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.445113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47fdb8851b2541d087797bcb76f4c9f2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.446270 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-66236af1-5ffd-443b-9ecc-a79ba644bc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47fdb8851b2541d087797bcb76f4c9f2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.467191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1330/2650] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:06 2022] DELETE /identity/v3/users/47fdb8851b2541d087797bcb76f4c9f2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:06.754477 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:06.755952 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:06.775219 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252fe1-4581-47ad-b84c-bb4122834ec6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:06.811452 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:06.839164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:06.840074 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:06.840383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:06.840707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] PATH_INFO: `/v3/projects/d837cb3c5f4642bebd97c873fbff0d3c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:06.841930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d837cb3c5f4642bebd97c873fbff0d3c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:06.843895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:06.898459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd837cb3c5f4642bebd97c873fbff0d3c', 'request_id': 'req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.905694 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd837cb3c5f4642bebd97c873fbff0d3c', 'request_id': 'req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.914978 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd837cb3c5f4642bebd97c873fbff0d3c', 'request_id': 'req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.927146 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] The token cache is being invalidate because project d837cb3c5f4642bebd97c873fbff0d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:06.927431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.928077 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6cfc6b1d-9931-4f64-a44d-0a0900f9a5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:06.929695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1321/2651] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:06 2022] DELETE /identity/v3/projects/d837cb3c5f4642bebd97c873fbff0d3c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:06.934932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40206033-8dfe-4f79-a172-b27fba978a38 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:06.935512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40206033-8dfe-4f79-a172-b27fba978a38 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:06.935512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40206033-8dfe-4f79-a172-b27fba978a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:06.955701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-40206033-8dfe-4f79-a172-b27fba978a38 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:06.957027 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-40206033-8dfe-4f79-a172-b27fba978a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:07.018355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1331/2652] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:19:07.026778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed26d42-0314-4880-b97b-cc86baad8577 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.027142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed26d42-0314-4880-b97b-cc86baad8577 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.027492 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed26d42-0314-4880-b97b-cc86baad8577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.051123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0ed26d42-0314-4880-b97b-cc86baad8577 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:07.052534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0ed26d42-0314-4880-b97b-cc86baad8577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:07.062453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1322/2653] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:07.067130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40206033-8dfe-4f79-a172-b27fba978a38 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.077861 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40206033-8dfe-4f79-a172-b27fba978a38 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.082807 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c8f2-071e-4b2a-84df-e160231a33c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.083599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c8f2-071e-4b2a-84df-e160231a33c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.083953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c8f2-071e-4b2a-84df-e160231a33c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.084232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c8f2-071e-4b2a-84df-e160231a33c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.084976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537c8f2-071e-4b2a-84df-e160231a33c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:19:07.085319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537c8f2-071e-4b2a-84df-e160231a33c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.086936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537c8f2-071e-4b2a-84df-e160231a33c0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.102186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1332/2654] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:19:07.106544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed26d42-0314-4880-b97b-cc86baad8577 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.117497 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed26d42-0314-4880-b97b-cc86baad8577 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.123145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108ca5b-1ff6-4c1c-9bef-9d2da47bc5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.123833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ca5b-1ff6-4c1c-9bef-9d2da47bc5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.124117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ca5b-1ff6-4c1c-9bef-9d2da47bc5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.124396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ca5b-1ff6-4c1c-9bef-9d2da47bc5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.125105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108ca5b-1ff6-4c1c-9bef-9d2da47bc5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.127082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108ca5b-1ff6-4c1c-9bef-9d2da47bc5d2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.163621 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1323/2655] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:19:07 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:07.164830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c8f2-071e-4b2a-84df-e160231a33c0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.172477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:07.176681 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c8f2-071e-4b2a-84df-e160231a33c0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.257993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1476e5-7623-45cb-8b7d-5fffe7eedf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.258896 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1476e5-7623-45cb-8b7d-5fffe7eedf61 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.259609 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1476e5-7623-45cb-8b7d-5fffe7eedf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.259891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1476e5-7623-45cb-8b7d-5fffe7eedf61 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.260776 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1476e5-7623-45cb-8b7d-5fffe7eedf61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.263209 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1476e5-7623-45cb-8b7d-5fffe7eedf61 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.286292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1333/2656] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:19:07 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:07.289811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108ca5b-1ff6-4c1c-9bef-9d2da47bc5d2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.301001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108ca5b-1ff6-4c1c-9bef-9d2da47bc5d2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.306992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af16c4-13a1-45e3-b7a5-09aea3f6ed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.307799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af16c4-13a1-45e3-b7a5-09aea3f6ed1a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.308082 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af16c4-13a1-45e3-b7a5-09aea3f6ed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.308363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af16c4-13a1-45e3-b7a5-09aea3f6ed1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.309136 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af16c4-13a1-45e3-b7a5-09aea3f6ed1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.310789 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af16c4-13a1-45e3-b7a5-09aea3f6ed1a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.322166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1324/2657] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:07.326232 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1476e5-7623-45cb-8b7d-5fffe7eedf61 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.336260 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1476e5-7623-45cb-8b7d-5fffe7eedf61 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.341005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a6699-b5c8-44c8-ba43-0c59d7553ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.341710 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a6699-b5c8-44c8-ba43-0c59d7553ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.341998 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a6699-b5c8-44c8-ba43-0c59d7553ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.342269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a6699-b5c8-44c8-ba43-0c59d7553ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.343001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a6699-b5c8-44c8-ba43-0c59d7553ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.344599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a6699-b5c8-44c8-ba43-0c59d7553ddb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.355496 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1334/2658] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:07.360069 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af16c4-13a1-45e3-b7a5-09aea3f6ed1a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.370808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af16c4-13a1-45e3-b7a5-09aea3f6ed1a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.375696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306de9d6-5312-4633-9970-2d3263a74c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.376719 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306de9d6-5312-4633-9970-2d3263a74c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.377061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306de9d6-5312-4633-9970-2d3263a74c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.377392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306de9d6-5312-4633-9970-2d3263a74c0d admin admin] PATH_INFO: `/v3/projects/a9b033e920234cffaa795cb62fa46a58/users/8f0b28245db94f48bd32b6ff3cab8aed/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.392847 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306de9d6-5312-4633-9970-2d3263a74c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b033e920234cffaa795cb62fa46a58, user_id=8f0b28245db94f48bd32b6ff3cab8aed, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.395556 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306de9d6-5312-4633-9970-2d3263a74c0d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.418066 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1325/2659] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:07 2022] PUT /identity/v3/projects/a9b033e920234cffaa795cb62fa46a58/users/8f0b28245db94f48bd32b6ff3cab8aed/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:07.425266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a0af-7a06-4d68-9f82-648a1c6dc9ec None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.425512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a0af-7a06-4d68-9f82-648a1c6dc9ec None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.425693 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a0af-7a06-4d68-9f82-648a1c6dc9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.457744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0945a0af-7a06-4d68-9f82-648a1c6dc9ec None None] MFA Rules not processed for user `8f0b28245db94f48bd32b6ff3cab8aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:07.459169 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0945a0af-7a06-4d68-9f82-648a1c6dc9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:07.529751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1335/2660] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:07.534647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306de9d6-5312-4633-9970-2d3263a74c0d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.602574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306de9d6-5312-4633-9970-2d3263a74c0d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.608705 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2045fb-65aa-444f-a5d2-71018428c5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.609148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2045fb-65aa-444f-a5d2-71018428c5ba admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.609534 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2045fb-65aa-444f-a5d2-71018428c5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.609879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2045fb-65aa-444f-a5d2-71018428c5ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.610648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2045fb-65aa-444f-a5d2-71018428c5ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.612642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2045fb-65aa-444f-a5d2-71018428c5ba admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.618405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:07.649248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1326/2661] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:19:07 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:07.652177 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a0af-7a06-4d68-9f82-648a1c6dc9ec None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.664373 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a0af-7a06-4d68-9f82-648a1c6dc9ec None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.726259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aebfae-6759-4a40-87da-60157ee7188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.726950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebfae-6759-4a40-87da-60157ee7188b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.727237 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebfae-6759-4a40-87da-60157ee7188b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.727517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebfae-6759-4a40-87da-60157ee7188b admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.728963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aebfae-6759-4a40-87da-60157ee7188b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.730964 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aebfae-6759-4a40-87da-60157ee7188b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.754981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1336/2662] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:19:07 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:19:07.758771 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2045fb-65aa-444f-a5d2-71018428c5ba admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.770320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2045fb-65aa-444f-a5d2-71018428c5ba admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.776449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03adeef-d181-4100-bd26-d1b542dfe73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.777142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03adeef-d181-4100-bd26-d1b542dfe73f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.777467 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03adeef-d181-4100-bd26-d1b542dfe73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.777740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03adeef-d181-4100-bd26-d1b542dfe73f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.778503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03adeef-d181-4100-bd26-d1b542dfe73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.780221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03adeef-d181-4100-bd26-d1b542dfe73f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.800514 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1327/2663] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:07.805308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aebfae-6759-4a40-87da-60157ee7188b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.813989 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:07.822384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aebfae-6759-4a40-87da-60157ee7188b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.830247 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0631e84-acef-42b1-ba16-95f2fffd825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.831806 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0631e84-acef-42b1-ba16-95f2fffd825b admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.832596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0631e84-acef-42b1-ba16-95f2fffd825b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.833307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0631e84-acef-42b1-ba16-95f2fffd825b admin admin] PATH_INFO: `/v3/projects/1e8ec83588c64c4f96446e4879de1b9a/users/4d42f762211941e3812267792faca288/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.865899 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0631e84-acef-42b1-ba16-95f2fffd825b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8ec83588c64c4f96446e4879de1b9a, user_id=4d42f762211941e3812267792faca288, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.868818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0631e84-acef-42b1-ba16-95f2fffd825b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.887173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1337/2664] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:07 2022] PUT /identity/v3/projects/1e8ec83588c64c4f96446e4879de1b9a/users/4d42f762211941e3812267792faca288/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:07.892185 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03adeef-d181-4100-bd26-d1b542dfe73f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:07.902656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03adeef-d181-4100-bd26-d1b542dfe73f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:07.970401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995ae29-f6f1-4eab-970e-e4b980ec1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:07.971092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ae29-f6f1-4eab-970e-e4b980ec1c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:07.971371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ae29-f6f1-4eab-970e-e4b980ec1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:07.971649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ae29-f6f1-4eab-970e-e4b980ec1c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:07.972434 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995ae29-f6f1-4eab-970e-e4b980ec1c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:07.974353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995ae29-f6f1-4eab-970e-e4b980ec1c3e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:07.989437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1328/2665] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:07.990719 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0631e84-acef-42b1-ba16-95f2fffd825b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:08.002922 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0631e84-acef-42b1-ba16-95f2fffd825b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:08.008432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6039a-9068-40b0-82c6-a2aaf0e6592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:08.009652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6039a-9068-40b0-82c6-a2aaf0e6592b admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:08.010266 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6039a-9068-40b0-82c6-a2aaf0e6592b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:08.010409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6039a-9068-40b0-82c6-a2aaf0e6592b admin admin] PATH_INFO: `/v3/projects/1e8ec83588c64c4f96446e4879de1b9a/users/4d42f762211941e3812267792faca288/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:08.014033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6039a-9068-40b0-82c6-a2aaf0e6592b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8ec83588c64c4f96446e4879de1b9a, user_id=4d42f762211941e3812267792faca288, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:08.016183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6039a-9068-40b0-82c6-a2aaf0e6592b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:08.039233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1338/2666] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:07 2022] PUT /identity/v3/projects/1e8ec83588c64c4f96446e4879de1b9a/users/4d42f762211941e3812267792faca288/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:08.041570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b2b5-2d5b-4cd7-a535-0979a66fe06a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:08.041932 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b2b5-2d5b-4cd7-a535-0979a66fe06a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:08.042489 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b2b5-2d5b-4cd7-a535-0979a66fe06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:08.079736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3531b2b5-2d5b-4cd7-a535-0979a66fe06a None None] MFA Rules not processed for user `4d42f762211941e3812267792faca288`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:08.081497 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3531b2b5-2d5b-4cd7-a535-0979a66fe06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:08.163088 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1329/2667] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:08.175050 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6039a-9068-40b0-82c6-a2aaf0e6592b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:08.178088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-58a6039a-9068-40b0-82c6-a2aaf0e6592b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:08.238206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6039a-9068-40b0-82c6-a2aaf0e6592b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:08.241981 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fe9dc-6bff-43b5-bbd5-eafa275769d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:08.242637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe9dc-6bff-43b5-bbd5-eafa275769d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:08.242920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe9dc-6bff-43b5-bbd5-eafa275769d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:08.243198 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe9dc-6bff-43b5-bbd5-eafa275769d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:08.253243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fe9dc-6bff-43b5-bbd5-eafa275769d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:08.254684 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fe9dc-6bff-43b5-bbd5-eafa275769d7 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:08.264724 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1339/2668] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:08.332139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b2b5-2d5b-4cd7-a535-0979a66fe06a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:08.392494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:08.399446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b2b5-2d5b-4cd7-a535-0979a66fe06a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:08.406290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:08.407183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:08.407502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:08.407742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] PATH_INFO: `/v3/users/8f0b28245db94f48bd32b6ff3cab8aed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:08.411646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0b28245db94f48bd32b6ff3cab8aed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:08.413661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:08.465810 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0b28245db94f48bd32b6ff3cab8aed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:08.473060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0b28245db94f48bd32b6ff3cab8aed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:08.473835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0b28245db94f48bd32b6ff3cab8aed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:08.483616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0b28245db94f48bd32b6ff3cab8aed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:08.499798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0b28245db94f48bd32b6ff3cab8aed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:08.509496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1330/2669] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:08 2022] DELETE /identity/v3/users/8f0b28245db94f48bd32b6ff3cab8aed => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:08.514612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea714873-5426-4150-bfd0-014cbda976f8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:08.514906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea714873-5426-4150-bfd0-014cbda976f8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:08.515215 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea714873-5426-4150-bfd0-014cbda976f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:08.536100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ea714873-5426-4150-bfd0-014cbda976f8 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:08.537542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ea714873-5426-4150-bfd0-014cbda976f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:08.614406 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1340/2670] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:08.627529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:08.629141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:08.704772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8edcff-6a09-4921-a3aa-8048eb2aadaf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:08.710068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818d2b7-898d-47da-bfd4-9615865e53ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:08.710742 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818d2b7-898d-47da-bfd4-9615865e53ae service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:08.711025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818d2b7-898d-47da-bfd4-9615865e53ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:08.711299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818d2b7-898d-47da-bfd4-9615865e53ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:08.726359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818d2b7-898d-47da-bfd4-9615865e53ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:08.728011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818d2b7-898d-47da-bfd4-9615865e53ae service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:08.740253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1331/2671] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:09.311157 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea714873-5426-4150-bfd0-014cbda976f8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:09.313131 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ea714873-5426-4150-bfd0-014cbda976f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:09.327888 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea714873-5426-4150-bfd0-014cbda976f8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:09.334317 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:09.335238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:09.335705 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:09.336391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] PATH_INFO: `/v3/projects/a9b033e920234cffaa795cb62fa46a58` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:09.338761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b033e920234cffaa795cb62fa46a58)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:09.343011 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:09.400950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b033e920234cffaa795cb62fa46a58', 'request_id': 'req-03c7d931-fa17-49da-a668-4d8603b2682e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.405464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818d2b7-898d-47da-bfd4-9615865e53ae service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:09.406912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5818d2b7-898d-47da-bfd4-9615865e53ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:09.413834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b033e920234cffaa795cb62fa46a58', 'request_id': 'req-03c7d931-fa17-49da-a668-4d8603b2682e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.426790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b033e920234cffaa795cb62fa46a58', 'request_id': 'req-03c7d931-fa17-49da-a668-4d8603b2682e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.429448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:09.463307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] The token cache is being invalidate because project a9b033e920234cffaa795cb62fa46a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:09.463544 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.464292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.469258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1341/2672] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:09 2022] DELETE /identity/v3/projects/a9b033e920234cffaa795cb62fa46a58 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:09.472512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:09.474408 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:09.523496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818d2b7-898d-47da-bfd4-9615865e53ae service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:09.547044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:09.582064 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d931-fa17-49da-a668-4d8603b2682e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:09.586856 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:09.588315 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:09.588594 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:09.588855 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] PATH_INFO: `/v3/users/4d42f762211941e3812267792faca288` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:09.590162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d42f762211941e3812267792faca288)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:09.592104 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:09.603045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed11e69-4345-458f-93fe-308c5d868936 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:09.603715 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed11e69-4345-458f-93fe-308c5d868936 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:09.603997 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed11e69-4345-458f-93fe-308c5d868936 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:09.604270 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed11e69-4345-458f-93fe-308c5d868936 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:09.606379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5ed11e69-4345-458f-93fe-308c5d868936 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:09.623664 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed11e69-4345-458f-93fe-308c5d868936 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:09.625746 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed11e69-4345-458f-93fe-308c5d868936 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:09.638396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1332/2673] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:09.639276 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed11e69-4345-458f-93fe-308c5d868936 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:09.640697 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5ed11e69-4345-458f-93fe-308c5d868936 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:09.644915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d42f762211941e3812267792faca288'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.652857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d42f762211941e3812267792faca288'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.653694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d42f762211941e3812267792faca288'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.655371 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed11e69-4345-458f-93fe-308c5d868936 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:09.661494 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:09.662542 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:09.662684 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:09.662961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] PATH_INFO: `/v3/users/81f7520d68b3473cbba90d8581afbfac` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:09.664255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f7520d68b3473cbba90d8581afbfac)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:09.664892 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d42f762211941e3812267792faca288'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.665689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d42f762211941e3812267792faca288'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.666573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:09.688950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1342/2674] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:09 2022] DELETE /identity/v3/users/4d42f762211941e3812267792faca288 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:09.718851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f7520d68b3473cbba90d8581afbfac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.726895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f7520d68b3473cbba90d8581afbfac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.727686 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f7520d68b3473cbba90d8581afbfac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.735490 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f7520d68b3473cbba90d8581afbfac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.750794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f7520d68b3473cbba90d8581afbfac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:09.757734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1333/2675] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:09 2022] DELETE /identity/v3/users/81f7520d68b3473cbba90d8581afbfac => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:09.955269 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:09.957128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:09.990721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:09.992419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:10.032281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbab25-a9ee-44b6-8370-37e3c75e9343 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.044762 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:10.065828 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d0271-2403-462b-b305-2acf50ee9fc5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.070376 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.071359 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.071822 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.072105 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] PATH_INFO: `/v3/projects/1e8ec83588c64c4f96446e4879de1b9a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.073675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8ec83588c64c4f96446e4879de1b9a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.075634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.093727 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.094527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.094812 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.095092 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] PATH_INFO: `/v3/projects/02b2be78491c4b9da9fa91a7c8892640` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.096271 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b2be78491c4b9da9fa91a7c8892640)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.098296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.107319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:10.125912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8ec83588c64c4f96446e4879de1b9a', 'request_id': 'req-4915dc83-a22c-4070-81a4-6cf7791ba937'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:10.132246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8ec83588c64c4f96446e4879de1b9a', 'request_id': 'req-4915dc83-a22c-4070-81a4-6cf7791ba937'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:10.141247 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8ec83588c64c4f96446e4879de1b9a', 'request_id': 'req-4915dc83-a22c-4070-81a4-6cf7791ba937'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:10.145840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b2be78491c4b9da9fa91a7c8892640', 'request_id': 'req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:10.152353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b2be78491c4b9da9fa91a7c8892640', 'request_id': 'req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:10.152548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] The token cache is being invalidate because project 1e8ec83588c64c4f96446e4879de1b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:10.152832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:10.153522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4915dc83-a22c-4070-81a4-6cf7791ba937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:10.155401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1334/2676] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:09 2022] DELETE /identity/v3/projects/1e8ec83588c64c4f96446e4879de1b9a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:10.159994 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee25ef-7660-42cb-a259-26e392ffd4c9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.160286 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee25ef-7660-42cb-a259-26e392ffd4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.160567 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee25ef-7660-42cb-a259-26e392ffd4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.162717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b2be78491c4b9da9fa91a7c8892640', 'request_id': 'req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:10.174339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] The token cache is being invalidate because project 02b2be78491c4b9da9fa91a7c8892640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:10.174625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:10.175251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cf6ffc3-259d-414f-a493-b58a0a8f0a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:10.176827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1343/2677] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:09 2022] DELETE /identity/v3/projects/02b2be78491c4b9da9fa91a7c8892640 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:19:10.180496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1fee25ef-7660-42cb-a259-26e392ffd4c9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:10.180496 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1fee25ef-7660-42cb-a259-26e392ffd4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:10.181974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa84c-bdce-47fe-a6e1-90c391578434 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.182327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa84c-bdce-47fe-a6e1-90c391578434 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.182524 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa84c-bdce-47fe-a6e1-90c391578434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.201071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-561fa84c-bdce-47fe-a6e1-90c391578434 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:10.202314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-561fa84c-bdce-47fe-a6e1-90c391578434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:10.241733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1335/2678] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:19:10.249530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c21c5a-b891-4130-856e-129e038be8f9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.249811 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c21c5a-b891-4130-856e-129e038be8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.250086 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c21c5a-b891-4130-856e-129e038be8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.262879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1344/2679] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:19:10.269060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-09c21c5a-b891-4130-856e-129e038be8f9 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:10.270543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-09c21c5a-b891-4130-856e-129e038be8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:10.270824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de7ec-205e-419d-956b-1f4708d1d5e4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.271117 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de7ec-205e-419d-956b-1f4708d1d5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.271409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de7ec-205e-419d-956b-1f4708d1d5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.279220 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1336/2680] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:19:10.282585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c21c5a-b891-4130-856e-129e038be8f9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.290035 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3e8de7ec-205e-419d-956b-1f4708d1d5e4 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:10.291305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3e8de7ec-205e-419d-956b-1f4708d1d5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:10.291753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c21c5a-b891-4130-856e-129e038be8f9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.296419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19a6b2-38db-4e06-95cc-c070479a4e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.297069 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19a6b2-38db-4e06-95cc-c070479a4e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.297389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19a6b2-38db-4e06-95cc-c070479a4e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.297663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19a6b2-38db-4e06-95cc-c070479a4e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.298421 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19a6b2-38db-4e06-95cc-c070479a4e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:19:10.298724 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19a6b2-38db-4e06-95cc-c070479a4e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.299289 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1345/2681] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:10.300318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19a6b2-38db-4e06-95cc-c070479a4e1a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.303380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de7ec-205e-419d-956b-1f4708d1d5e4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.312419 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1337/2682] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:19:10.312833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de7ec-205e-419d-956b-1f4708d1d5e4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.316513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19a6b2-38db-4e06-95cc-c070479a4e1a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.318240 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c427c-ee95-47af-9a37-b0083d40af10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.318933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c427c-ee95-47af-9a37-b0083d40af10 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.319216 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c427c-ee95-47af-9a37-b0083d40af10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.319492 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c427c-ee95-47af-9a37-b0083d40af10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.320220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c427c-ee95-47af-9a37-b0083d40af10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:19:10.320531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c427c-ee95-47af-9a37-b0083d40af10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.322210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c427c-ee95-47af-9a37-b0083d40af10 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.326808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19a6b2-38db-4e06-95cc-c070479a4e1a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.331393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c0f56-afc6-4cc8-8c7d-304e5498c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.332025 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c0f56-afc6-4cc8-8c7d-304e5498c9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.332305 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c0f56-afc6-4cc8-8c7d-304e5498c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.332576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c0f56-afc6-4cc8-8c7d-304e5498c9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.333278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c0f56-afc6-4cc8-8c7d-304e5498c9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.338251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1346/2683] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 15:19:10.338413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c0f56-afc6-4cc8-8c7d-304e5498c9d6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.339268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c427c-ee95-47af-9a37-b0083d40af10 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.349593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c427c-ee95-47af-9a37-b0083d40af10 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.355246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcbbf3-5eeb-4c6f-bcdc-24562445e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.355908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcbbf3-5eeb-4c6f-bcdc-24562445e359 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.356194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcbbf3-5eeb-4c6f-bcdc-24562445e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.356469 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcbbf3-5eeb-4c6f-bcdc-24562445e359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.357188 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcbbf3-5eeb-4c6f-bcdc-24562445e359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.359236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcbbf3-5eeb-4c6f-bcdc-24562445e359 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.363717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1338/2684] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:19:10.367859 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c0f56-afc6-4cc8-8c7d-304e5498c9d6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.387290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1347/2685] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:10.391511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcbbf3-5eeb-4c6f-bcdc-24562445e359 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.400400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:10.435209 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c0f56-afc6-4cc8-8c7d-304e5498c9d6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.452630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:10.456968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcbbf3-5eeb-4c6f-bcdc-24562445e359 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.461572 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ee6b9-6960-45b4-9039-69eb675a77ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.462349 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ee6b9-6960-45b4-9039-69eb675a77ce admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.462622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ee6b9-6960-45b4-9039-69eb675a77ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.462945 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ee6b9-6960-45b4-9039-69eb675a77ce admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.463743 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ee6b9-6960-45b4-9039-69eb675a77ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.466124 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ee6b9-6960-45b4-9039-69eb675a77ce admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.490907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1348/2686] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:10.491942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ee6b9-6960-45b4-9039-69eb675a77ce admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.495117 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b62ac-ff09-4bec-be64-c81a8b90b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.495798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b62ac-ff09-4bec-be64-c81a8b90b96a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.496084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b62ac-ff09-4bec-be64-c81a8b90b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.496389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b62ac-ff09-4bec-be64-c81a8b90b96a admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.497080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b62ac-ff09-4bec-be64-c81a8b90b96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.499087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b62ac-ff09-4bec-be64-c81a8b90b96a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.501764 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ee6b9-6960-45b4-9039-69eb675a77ce admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.506392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcca673-31ec-4781-91e7-1fa564d88b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.507042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcca673-31ec-4781-91e7-1fa564d88b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.507321 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcca673-31ec-4781-91e7-1fa564d88b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.507605 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcca673-31ec-4781-91e7-1fa564d88b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.508296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcca673-31ec-4781-91e7-1fa564d88b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.510236 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcca673-31ec-4781-91e7-1fa564d88b63 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.524637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1349/2687] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:10.524849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1339/2688] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:19:10.526652 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcca673-31ec-4781-91e7-1fa564d88b63 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.526797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b62ac-ff09-4bec-be64-c81a8b90b96a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.536871 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b62ac-ff09-4bec-be64-c81a8b90b96a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.537460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcca673-31ec-4781-91e7-1fa564d88b63 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.541868 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367e464-dfb4-4391-bcb4-8c5d237627a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.542535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367e464-dfb4-4391-bcb4-8c5d237627a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.542740 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ba23e-e255-4c0b-bf01-5e7a2c9dda9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.542859 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367e464-dfb4-4391-bcb4-8c5d237627a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.543085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367e464-dfb4-4391-bcb4-8c5d237627a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.543411 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ba23e-e255-4c0b-bf01-5e7a2c9dda9a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.543695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ba23e-e255-4c0b-bf01-5e7a2c9dda9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.543799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367e464-dfb4-4391-bcb4-8c5d237627a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.543969 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ba23e-e255-4c0b-bf01-5e7a2c9dda9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.544790 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ba23e-e255-4c0b-bf01-5e7a2c9dda9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.545429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367e464-dfb4-4391-bcb4-8c5d237627a4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.546453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ba23e-e255-4c0b-bf01-5e7a2c9dda9a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.555723 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1340/2689] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:10.558014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1350/2690] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:10.559910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367e464-dfb4-4391-bcb4-8c5d237627a4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.561948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ba23e-e255-4c0b-bf01-5e7a2c9dda9a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.570457 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367e464-dfb4-4391-bcb4-8c5d237627a4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.571505 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ba23e-e255-4c0b-bf01-5e7a2c9dda9a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.575739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b26b1-11f9-4564-9fa2-a608747b13eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.576415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b26b1-11f9-4564-9fa2-a608747b13eb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.576696 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b26b1-11f9-4564-9fa2-a608747b13eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.576972 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b26b1-11f9-4564-9fa2-a608747b13eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.577076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b3416-9b64-4d26-b087-f904a1d70677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.577733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b26b1-11f9-4564-9fa2-a608747b13eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.578053 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b3416-9b64-4d26-b087-f904a1d70677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.578326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b3416-9b64-4d26-b087-f904a1d70677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.578598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b3416-9b64-4d26-b087-f904a1d70677 admin admin] PATH_INFO: `/v3/projects/124bab10dd2f484ab0315edaa3fcf17f/users/eaec9bf261194c82b5d9b2b0fdd5c276/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.579321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b26b1-11f9-4564-9fa2-a608747b13eb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.592717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1341/2691] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:10.593744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b26b1-11f9-4564-9fa2-a608747b13eb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.594484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b3416-9b64-4d26-b087-f904a1d70677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124bab10dd2f484ab0315edaa3fcf17f, user_id=eaec9bf261194c82b5d9b2b0fdd5c276, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.597335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b3416-9b64-4d26-b087-f904a1d70677 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.603726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b26b1-11f9-4564-9fa2-a608747b13eb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.608944 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cf5f0-fa02-4cac-8dbc-c6cc612c3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.609992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cf5f0-fa02-4cac-8dbc-c6cc612c3002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.610278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cf5f0-fa02-4cac-8dbc-c6cc612c3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.610558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cf5f0-fa02-4cac-8dbc-c6cc612c3002 admin admin] PATH_INFO: `/v3/projects/35ebd30cfa4f4c159c9b2da32ec8143d/users/948c013e0e4e462992ad05dd7e957c23/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.612024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1351/2692] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:10 2022] PUT /identity/v3/projects/124bab10dd2f484ab0315edaa3fcf17f/users/eaec9bf261194c82b5d9b2b0fdd5c276/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:19:10.616995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c113-3856-448a-8521-88e4ece467a6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.617309 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c113-3856-448a-8521-88e4ece467a6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.617585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c113-3856-448a-8521-88e4ece467a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.627092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cf5f0-fa02-4cac-8dbc-c6cc612c3002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ebd30cfa4f4c159c9b2da32ec8143d, user_id=948c013e0e4e462992ad05dd7e957c23, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.629805 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cf5f0-fa02-4cac-8dbc-c6cc612c3002 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.636938 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9a65c113-3856-448a-8521-88e4ece467a6 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:10.638208 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9a65c113-3856-448a-8521-88e4ece467a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:10.646643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1342/2693] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:10 2022] PUT /identity/v3/projects/35ebd30cfa4f4c159c9b2da32ec8143d/users/948c013e0e4e462992ad05dd7e957c23/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:19:10.658401 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461849b-a723-4110-9a9f-c0d36a60cbf5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.658714 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461849b-a723-4110-9a9f-c0d36a60cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.658992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461849b-a723-4110-9a9f-c0d36a60cbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.686087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e461849b-a723-4110-9a9f-c0d36a60cbf5 None None] MFA Rules not processed for user `948c013e0e4e462992ad05dd7e957c23`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:10.687313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e461849b-a723-4110-9a9f-c0d36a60cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:10.703544 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1352/2694] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:10.713668 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65c113-3856-448a-8521-88e4ece467a6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.715173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9a65c113-3856-448a-8521-88e4ece467a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:10.753062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1343/2695] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:19:10.757599 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461849b-a723-4110-9a9f-c0d36a60cbf5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.768651 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461849b-a723-4110-9a9f-c0d36a60cbf5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.773336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18466de-9428-4ba4-8bed-b5ea60f01a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.773993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18466de-9428-4ba4-8bed-b5ea60f01a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.774273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18466de-9428-4ba4-8bed-b5ea60f01a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.774551 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18466de-9428-4ba4-8bed-b5ea60f01a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.774662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65c113-3856-448a-8521-88e4ece467a6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.775330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18466de-9428-4ba4-8bed-b5ea60f01a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.777399 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18466de-9428-4ba4-8bed-b5ea60f01a8d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.778483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c28c35-b39a-4048-82df-d996bdc84bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.779140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c28c35-b39a-4048-82df-d996bdc84bab service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.779425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c28c35-b39a-4048-82df-d996bdc84bab service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.779729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c28c35-b39a-4048-82df-d996bdc84bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.786739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:10.795394 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c28c35-b39a-4048-82df-d996bdc84bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.797477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c28c35-b39a-4048-82df-d996bdc84bab service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.808775 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1353/2696] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:10.814502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1344/2697] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:19:10.815557 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c28c35-b39a-4048-82df-d996bdc84bab service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.825580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c28c35-b39a-4048-82df-d996bdc84bab service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.883990 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc692be-7d51-4cba-9afb-4a14ddca77a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.884627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc692be-7d51-4cba-9afb-4a14ddca77a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.884915 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc692be-7d51-4cba-9afb-4a14ddca77a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.885191 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc692be-7d51-4cba-9afb-4a14ddca77a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.885913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc692be-7d51-4cba-9afb-4a14ddca77a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.887957 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc692be-7d51-4cba-9afb-4a14ddca77a9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.909250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1354/2698] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:19:10 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:19:10.912647 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18466de-9428-4ba4-8bed-b5ea60f01a8d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.923470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18466de-9428-4ba4-8bed-b5ea60f01a8d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.928471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a693fa-6468-49d6-9afa-49a33540c862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.929332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a693fa-6468-49d6-9afa-49a33540c862 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.929623 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a693fa-6468-49d6-9afa-49a33540c862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.929899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a693fa-6468-49d6-9afa-49a33540c862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.930837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a693fa-6468-49d6-9afa-49a33540c862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.932554 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a693fa-6468-49d6-9afa-49a33540c862 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:10.944024 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1345/2699] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:19:10.949079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc692be-7d51-4cba-9afb-4a14ddca77a9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:10.959761 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc692be-7d51-4cba-9afb-4a14ddca77a9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:10.964924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ef44a-3908-44af-9cbd-b2a213953ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:10.965852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef44a-3908-44af-9cbd-b2a213953ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:10.966213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef44a-3908-44af-9cbd-b2a213953ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:10.966412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef44a-3908-44af-9cbd-b2a213953ea7 admin admin] PATH_INFO: `/v3/projects/740526c707ce4dc39f2635b839bf4c05/users/b6595c17bfe2408da88b5946bc7851ac/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:10.984181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ef44a-3908-44af-9cbd-b2a213953ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740526c707ce4dc39f2635b839bf4c05, user_id=b6595c17bfe2408da88b5946bc7851ac, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:10.987026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ef44a-3908-44af-9cbd-b2a213953ea7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:11.001445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1355/2700] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:10 2022] PUT /identity/v3/projects/740526c707ce4dc39f2635b839bf4c05/users/b6595c17bfe2408da88b5946bc7851ac/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:11.005661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a693fa-6468-49d6-9afa-49a33540c862 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:11.018196 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a693fa-6468-49d6-9afa-49a33540c862 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:11.037049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:11.083195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89480a47-5af6-4674-b4ad-d3799c97f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:11.083962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89480a47-5af6-4674-b4ad-d3799c97f074 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:11.084238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89480a47-5af6-4674-b4ad-d3799c97f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:11.084596 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89480a47-5af6-4674-b4ad-d3799c97f074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:11.085379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89480a47-5af6-4674-b4ad-d3799c97f074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:11.087268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89480a47-5af6-4674-b4ad-d3799c97f074 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:11.103527 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1346/2701] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:11.105110 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ef44a-3908-44af-9cbd-b2a213953ea7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:11.118280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ef44a-3908-44af-9cbd-b2a213953ea7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:11.124465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9cf93-e311-4c45-9c03-a48956afd2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:11.125499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9cf93-e311-4c45-9c03-a48956afd2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:11.125857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9cf93-e311-4c45-9c03-a48956afd2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:11.126038 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9cf93-e311-4c45-9c03-a48956afd2b4 admin admin] PATH_INFO: `/v3/projects/740526c707ce4dc39f2635b839bf4c05/users/b6595c17bfe2408da88b5946bc7851ac/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:11.128184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9cf93-e311-4c45-9c03-a48956afd2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740526c707ce4dc39f2635b839bf4c05, user_id=b6595c17bfe2408da88b5946bc7851ac, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:11.131071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9cf93-e311-4c45-9c03-a48956afd2b4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:11.142934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1356/2702] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:11 2022] PUT /identity/v3/projects/740526c707ce4dc39f2635b839bf4c05/users/b6595c17bfe2408da88b5946bc7851ac/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 15:19:11.153702 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8d44-966d-4f80-b5d5-f9f314c209a5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:11.154030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8d44-966d-4f80-b5d5-f9f314c209a5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:11.154807 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8d44-966d-4f80-b5d5-f9f314c209a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:11.182809 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7f4b8d44-966d-4f80-b5d5-f9f314c209a5 None None] MFA Rules not processed for user `b6595c17bfe2408da88b5946bc7851ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:11.184098 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7f4b8d44-966d-4f80-b5d5-f9f314c209a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:11.257510 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1347/2703] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:11.268951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9cf93-e311-4c45-9c03-a48956afd2b4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:11.270779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8ee9cf93-e311-4c45-9c03-a48956afd2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:11.331991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9cf93-e311-4c45-9c03-a48956afd2b4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:11.336472 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a59d04-bd83-4c3b-ae6b-263705ecf74a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:11.337426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59d04-bd83-4c3b-ae6b-263705ecf74a service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:11.337729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59d04-bd83-4c3b-ae6b-263705ecf74a service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:11.338712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59d04-bd83-4c3b-ae6b-263705ecf74a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:11.349740 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a59d04-bd83-4c3b-ae6b-263705ecf74a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:11.351301 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a59d04-bd83-4c3b-ae6b-263705ecf74a service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:11.362355 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1357/2704] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:12.005538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8d44-966d-4f80-b5d5-f9f314c209a5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:12.098768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8d44-966d-4f80-b5d5-f9f314c209a5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:12.106453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:12.108806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:12.109304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:12.109953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] PATH_INFO: `/v3/users/948c013e0e4e462992ad05dd7e957c23` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:12.111879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] RBAC: Authorizing `identity:delete_user(user_id=948c013e0e4e462992ad05dd7e957c23)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:12.114535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:12.207988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:12.211773 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948c013e0e4e462992ad05dd7e957c23'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:12.222869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948c013e0e4e462992ad05dd7e957c23'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:12.223875 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948c013e0e4e462992ad05dd7e957c23'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:12.235175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948c013e0e4e462992ad05dd7e957c23'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:12.248990 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948c013e0e4e462992ad05dd7e957c23'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:12.256195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1348/2705] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:12 2022] DELETE /identity/v3/users/948c013e0e4e462992ad05dd7e957c23 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:12.263210 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6982c-1cdb-4663-83fa-09276ef583a1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:12.265070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6982c-1cdb-4663-83fa-09276ef583a1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:12.265795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6982c-1cdb-4663-83fa-09276ef583a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:12.286778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-65a6982c-1cdb-4663-83fa-09276ef583a1 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:12.287978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-65a6982c-1cdb-4663-83fa-09276ef583a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:12.355853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:12.383140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1358/2706] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:12.393154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:12.402480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:12.486256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b748fc-92e8-4be6-9b0f-8c3e2ce7845a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:12.492606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9cb60-4242-4d43-a4d5-d290aa1c5d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:12.493367 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9cb60-4242-4d43-a4d5-d290aa1c5d22 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:12.493602 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9cb60-4242-4d43-a4d5-d290aa1c5d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:12.494030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9cb60-4242-4d43-a4d5-d290aa1c5d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:12.505879 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9cb60-4242-4d43-a4d5-d290aa1c5d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:12.507383 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9cb60-4242-4d43-a4d5-d290aa1c5d22 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:12.518442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1349/2707] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:12.966627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6982c-1cdb-4663-83fa-09276ef583a1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:12.968601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-65a6982c-1cdb-4663-83fa-09276ef583a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:12.981901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6982c-1cdb-4663-83fa-09276ef583a1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:12.989126 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:12.990814 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:12.991491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:12.991978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] PATH_INFO: `/v3/projects/35ebd30cfa4f4c159c9b2da32ec8143d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:12.993699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ebd30cfa4f4c159c9b2da32ec8143d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:12.995920 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:13.063903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ebd30cfa4f4c159c9b2da32ec8143d', 'request_id': 'req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:13.070905 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ebd30cfa4f4c159c9b2da32ec8143d', 'request_id': 'req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:13.081258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ebd30cfa4f4c159c9b2da32ec8143d', 'request_id': 'req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:13.095493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] The token cache is being invalidate because project 35ebd30cfa4f4c159c9b2da32ec8143d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:13.096055 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:13.096857 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:13.098771 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1359/2708] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:12 2022] DELETE /identity/v3/projects/35ebd30cfa4f4c159c9b2da32ec8143d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:13.102982 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9cb60-4242-4d43-a4d5-d290aa1c5d22 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:13.113535 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9cb60-4242-4d43-a4d5-d290aa1c5d22 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:13.184736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:13.185661 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:13.185940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:13.186345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] PATH_INFO: `/v3/users/b6595c17bfe2408da88b5946bc7851ac` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:13.187654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6595c17bfe2408da88b5946bc7851ac)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:13.189616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:13.255964 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6595c17bfe2408da88b5946bc7851ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:13.266501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6595c17bfe2408da88b5946bc7851ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:13.267400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6595c17bfe2408da88b5946bc7851ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:13.279230 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6595c17bfe2408da88b5946bc7851ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:13.282303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:13.297883 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2b957b23-c673-497d-821b-4b851bdc8142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6595c17bfe2408da88b5946bc7851ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:13.308431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1350/2709] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:13 2022] DELETE /identity/v3/users/b6595c17bfe2408da88b5946bc7851ac => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:13.838745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:13.841823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:13.860610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2d25a-6174-4b9b-88a6-86d32f48fc05 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:13.937979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:13.939026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:13.939402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:13.939798 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] PATH_INFO: `/v3/projects/740526c707ce4dc39f2635b839bf4c05` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:13.941233 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] RBAC: Authorizing `identity:delete_project(project_id=740526c707ce4dc39f2635b839bf4c05)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:13.943261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:14.008453 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740526c707ce4dc39f2635b839bf4c05', 'request_id': 'req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:14.015415 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740526c707ce4dc39f2635b839bf4c05', 'request_id': 'req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:14.025036 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740526c707ce4dc39f2635b839bf4c05', 'request_id': 'req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:14.044278 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] The token cache is being invalidate because project 740526c707ce4dc39f2635b839bf4c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:14.044676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:14.045446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d25ccbf-42a4-4001-b8e7-7ee18566b83f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:14.047494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1360/2710] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:13 2022] DELETE /identity/v3/projects/740526c707ce4dc39f2635b839bf4c05 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:14.053678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c62938-795e-4513-97c0-b40a5693df39 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.053678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c62938-795e-4513-97c0-b40a5693df39 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.053936 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c62938-795e-4513-97c0-b40a5693df39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.074511 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c5c62938-795e-4513-97c0-b40a5693df39 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:14.075503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c5c62938-795e-4513-97c0-b40a5693df39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:14.146058 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1351/2711] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:14.155312 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64160f-d2f1-483e-80e9-8d910928c5ff None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.155901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64160f-d2f1-483e-80e9-8d910928c5ff None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.156187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64160f-d2f1-483e-80e9-8d910928c5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.163047 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:14.180835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2b64160f-d2f1-483e-80e9-8d910928c5ff None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:14.185745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2b64160f-d2f1-483e-80e9-8d910928c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:14.196179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1361/2712] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:19:14.201138 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c62938-795e-4513-97c0-b40a5693df39 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:14.213500 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c62938-795e-4513-97c0-b40a5693df39 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:14.219030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d850e4-15c7-4038-a0c2-afebc2bd6e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:14.219713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d850e4-15c7-4038-a0c2-afebc2bd6e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.220271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d850e4-15c7-4038-a0c2-afebc2bd6e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.220271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d850e4-15c7-4038-a0c2-afebc2bd6e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.221002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d850e4-15c7-4038-a0c2-afebc2bd6e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:19:14.221346 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d850e4-15c7-4038-a0c2-afebc2bd6e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:14.223529 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d850e4-15c7-4038-a0c2-afebc2bd6e88 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:14.238101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1352/2713] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:19:14.242362 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64160f-d2f1-483e-80e9-8d910928c5ff None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:14.253121 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64160f-d2f1-483e-80e9-8d910928c5ff None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:14.259953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec49d92-b5ae-4129-b710-8a3b94741490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:14.260834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec49d92-b5ae-4129-b710-8a3b94741490 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.261068 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec49d92-b5ae-4129-b710-8a3b94741490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.261387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec49d92-b5ae-4129-b710-8a3b94741490 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.262173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec49d92-b5ae-4129-b710-8a3b94741490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:14.265856 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec49d92-b5ae-4129-b710-8a3b94741490 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:14.302772 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1362/2714] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:19:14 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:19:14.307140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d850e4-15c7-4038-a0c2-afebc2bd6e88 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:14.318448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d850e4-15c7-4038-a0c2-afebc2bd6e88 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:14.394653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84689-c6c1-415b-a647-dbf187078e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:14.395586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84689-c6c1-415b-a647-dbf187078e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.395967 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84689-c6c1-415b-a647-dbf187078e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.396343 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84689-c6c1-415b-a647-dbf187078e55 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.397227 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b84689-c6c1-415b-a647-dbf187078e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:14.399593 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b84689-c6c1-415b-a647-dbf187078e55 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:14.436384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1353/2715] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:19:14 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:14.440580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec49d92-b5ae-4129-b710-8a3b94741490 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:14.453152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec49d92-b5ae-4129-b710-8a3b94741490 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:14.458614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2e258-1539-497f-a09a-28dad2cb86af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:14.459511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e258-1539-497f-a09a-28dad2cb86af admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.459967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e258-1539-497f-a09a-28dad2cb86af admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.460432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e258-1539-497f-a09a-28dad2cb86af admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.461170 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2e258-1539-497f-a09a-28dad2cb86af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:14.463283 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2e258-1539-497f-a09a-28dad2cb86af admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:14.482882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1363/2716] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:14.486996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84689-c6c1-415b-a647-dbf187078e55 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:14.498026 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84689-c6c1-415b-a647-dbf187078e55 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:14.503277 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf7d15-7ab3-4066-afd1-626b99ddb5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:14.504085 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7d15-7ab3-4066-afd1-626b99ddb5cd admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.504553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7d15-7ab3-4066-afd1-626b99ddb5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.505611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7d15-7ab3-4066-afd1-626b99ddb5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.506498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf7d15-7ab3-4066-afd1-626b99ddb5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:14.509470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf7d15-7ab3-4066-afd1-626b99ddb5cd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:14.529260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1354/2717] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:14.530912 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2e258-1539-497f-a09a-28dad2cb86af admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:14.546284 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2e258-1539-497f-a09a-28dad2cb86af admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:14.552330 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e92b9-b48d-4be2-bd94-5a3b53da57f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:14.553474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e92b9-b48d-4be2-bd94-5a3b53da57f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.553791 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e92b9-b48d-4be2-bd94-5a3b53da57f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.554164 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e92b9-b48d-4be2-bd94-5a3b53da57f2 admin admin] PATH_INFO: `/v3/projects/afa890358ad546248601d7d4a99b28e4/users/a1ae9dc9386b46209b518bb773f852ba/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.574299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e92b9-b48d-4be2-bd94-5a3b53da57f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa890358ad546248601d7d4a99b28e4, user_id=a1ae9dc9386b46209b518bb773f852ba, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:14.577667 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e92b9-b48d-4be2-bd94-5a3b53da57f2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:14.598909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1364/2718] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:14 2022] PUT /identity/v3/projects/afa890358ad546248601d7d4a99b28e4/users/a1ae9dc9386b46209b518bb773f852ba/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:14.610741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5615af-3792-4ac9-b652-ca1c4730d8a7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.611124 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5615af-3792-4ac9-b652-ca1c4730d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.611468 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5615af-3792-4ac9-b652-ca1c4730d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.652996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ea5615af-3792-4ac9-b652-ca1c4730d8a7 None None] MFA Rules not processed for user `a1ae9dc9386b46209b518bb773f852ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:14.654439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ea5615af-3792-4ac9-b652-ca1c4730d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:14.697682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:14.736216 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1355/2719] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:14.749631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e92b9-b48d-4be2-bd94-5a3b53da57f2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:14.751650 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c06e92b9-b48d-4be2-bd94-5a3b53da57f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:14.835714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e92b9-b48d-4be2-bd94-5a3b53da57f2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:14.841532 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb592d-83a5-484b-9669-f0fe3e49b1d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:14.842299 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb592d-83a5-484b-9669-f0fe3e49b1d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.842661 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb592d-83a5-484b-9669-f0fe3e49b1d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.843007 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb592d-83a5-484b-9669-f0fe3e49b1d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.852430 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb592d-83a5-484b-9669-f0fe3e49b1d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:14.854739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb592d-83a5-484b-9669-f0fe3e49b1d3 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:14.869479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1365/2720] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:14.898574 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5615af-3792-4ac9-b652-ca1c4730d8a7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:14.980123 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5615af-3792-4ac9-b652-ca1c4730d8a7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:14.985589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:14.986484 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:14.986765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:14.987483 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] PATH_INFO: `/v3/users/a1ae9dc9386b46209b518bb773f852ba` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:14.988890 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ae9dc9386b46209b518bb773f852ba)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:14.992299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:15.074139 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ae9dc9386b46209b518bb773f852ba'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:15.082649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ae9dc9386b46209b518bb773f852ba'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:15.083446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ae9dc9386b46209b518bb773f852ba'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:15.104537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ae9dc9386b46209b518bb773f852ba'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:15.119851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d18ead57-be77-4cfa-8e24-e896693189cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ae9dc9386b46209b518bb773f852ba'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:15.127464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1356/2721] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:14 2022] DELETE /identity/v3/users/a1ae9dc9386b46209b518bb773f852ba => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:15.131926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354ce00-f4d0-4e29-aa60-3d00692fe362 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:15.132391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354ce00-f4d0-4e29-aa60-3d00692fe362 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:15.132844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354ce00-f4d0-4e29-aa60-3d00692fe362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:15.152451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9354ce00-f4d0-4e29-aa60-3d00692fe362 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:15.153718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9354ce00-f4d0-4e29-aa60-3d00692fe362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:15.207957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597db6-c660-4366-bffd-2ebdbce08cc9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:15.208446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597db6-c660-4366-bffd-2ebdbce08cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:15.208446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597db6-c660-4366-bffd-2ebdbce08cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:15.220690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1366/2722] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:15.230890 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354ce00-f4d0-4e29-aa60-3d00692fe362 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:15.232637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9354ce00-f4d0-4e29-aa60-3d00692fe362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:15.248517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-21597db6-c660-4366-bffd-2ebdbce08cc9 None None] MFA Rules not processed for user `eaec9bf261194c82b5d9b2b0fdd5c276`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:15.249917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-21597db6-c660-4366-bffd-2ebdbce08cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:15.311924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:15.326089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:15.327602 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354ce00-f4d0-4e29-aa60-3d00692fe362 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:15.331965 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e359e73-3616-4c98-9131-db8583468292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:15.332633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e359e73-3616-4c98-9131-db8583468292 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:15.332909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e359e73-3616-4c98-9131-db8583468292 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:15.333189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e359e73-3616-4c98-9131-db8583468292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:15.342992 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e359e73-3616-4c98-9131-db8583468292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:15.344438 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e359e73-3616-4c98-9131-db8583468292 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:15.349947 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1357/2723] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:19:15.356325 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1367/2724] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 15:19:15.374991 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597db6-c660-4366-bffd-2ebdbce08cc9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:15.376522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-21597db6-c660-4366-bffd-2ebdbce08cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:15.497794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597db6-c660-4366-bffd-2ebdbce08cc9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:15.504829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465158bc-fe50-4340-bdcb-20ad5a499940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:15.505687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465158bc-fe50-4340-bdcb-20ad5a499940 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:15.506081 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465158bc-fe50-4340-bdcb-20ad5a499940 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:15.506449 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465158bc-fe50-4340-bdcb-20ad5a499940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:15.516791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465158bc-fe50-4340-bdcb-20ad5a499940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:15.518853 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465158bc-fe50-4340-bdcb-20ad5a499940 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:15.531000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1358/2725] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:15.706101 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e359e73-3616-4c98-9131-db8583468292 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:15.708235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1e359e73-3616-4c98-9131-db8583468292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:15.723756 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e359e73-3616-4c98-9131-db8583468292 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:15.729718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:15.730286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:15.730566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:15.730919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] PATH_INFO: `/v3/projects/afa890358ad546248601d7d4a99b28e4` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:15.732262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa890358ad546248601d7d4a99b28e4)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:15.734448 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:15.795676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa890358ad546248601d7d4a99b28e4', 'request_id': 'req-caf9b418-2c56-405f-bea4-de173862ae1d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:15.806207 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa890358ad546248601d7d4a99b28e4', 'request_id': 'req-caf9b418-2c56-405f-bea4-de173862ae1d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:15.821163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa890358ad546248601d7d4a99b28e4', 'request_id': 'req-caf9b418-2c56-405f-bea4-de173862ae1d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:15.837542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] The token cache is being invalidate because project afa890358ad546248601d7d4a99b28e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:15.837959 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:15.838396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-caf9b418-2c56-405f-bea4-de173862ae1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:15.840258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1368/2726] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:15 2022] DELETE /identity/v3/projects/afa890358ad546248601d7d4a99b28e4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:15.845175 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a95690-3c0b-49bd-b291-79b58586d21e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:15.845583 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a95690-3c0b-49bd-b291-79b58586d21e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:15.845921 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a95690-3c0b-49bd-b291-79b58586d21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:15.868504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-10a95690-3c0b-49bd-b291-79b58586d21e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:15.870151 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-10a95690-3c0b-49bd-b291-79b58586d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:15.985433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1359/2727] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:15.993588 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dec017-186e-4f9f-a1b1-c5843963a245 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:15.994144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dec017-186e-4f9f-a1b1-c5843963a245 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:15.994243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dec017-186e-4f9f-a1b1-c5843963a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:16.014390 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e0dec017-186e-4f9f-a1b1-c5843963a245 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:16.015708 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e0dec017-186e-4f9f-a1b1-c5843963a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:16.027308 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1369/2728] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:16.031824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a95690-3c0b-49bd-b291-79b58586d21e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:16.042674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a95690-3c0b-49bd-b291-79b58586d21e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:16.048137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d691ba-7e2f-4fb6-b99a-b18c9930fbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:16.048829 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d691ba-7e2f-4fb6-b99a-b18c9930fbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:16.049104 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d691ba-7e2f-4fb6-b99a-b18c9930fbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:16.049409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d691ba-7e2f-4fb6-b99a-b18c9930fbf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:16.050142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d691ba-7e2f-4fb6-b99a-b18c9930fbf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:19:16.050448 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d691ba-7e2f-4fb6-b99a-b18c9930fbf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:16.052120 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d691ba-7e2f-4fb6-b99a-b18c9930fbf3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:16.070087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1360/2729] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:19:16.074861 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dec017-186e-4f9f-a1b1-c5843963a245 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:16.089018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dec017-186e-4f9f-a1b1-c5843963a245 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:16.095150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0061d-fa92-486e-863f-c075d632988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:16.096928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0061d-fa92-486e-863f-c075d632988d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:16.097348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0061d-fa92-486e-863f-c075d632988d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:16.097735 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0061d-fa92-486e-863f-c075d632988d admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:16.098463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0061d-fa92-486e-863f-c075d632988d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:16.100842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0061d-fa92-486e-863f-c075d632988d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:16.138512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1370/2730] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:19:16 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:19:16.139416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d691ba-7e2f-4fb6-b99a-b18c9930fbf3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:16.150708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d691ba-7e2f-4fb6-b99a-b18c9930fbf3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:16.217016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59ca67-1b68-4fbf-bd61-067f2e419f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:16.217808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59ca67-1b68-4fbf-bd61-067f2e419f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:16.218159 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59ca67-1b68-4fbf-bd61-067f2e419f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:16.218503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59ca67-1b68-4fbf-bd61-067f2e419f36 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:16.219385 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59ca67-1b68-4fbf-bd61-067f2e419f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:16.221466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59ca67-1b68-4fbf-bd61-067f2e419f36 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:16.229125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:16.249573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1361/2731] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:19:16 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:19:16.250906 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0061d-fa92-486e-863f-c075d632988d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:16.263897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0061d-fa92-486e-863f-c075d632988d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:16.269443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d48f1-92b0-438a-b91e-307b310fa052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:16.270206 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d48f1-92b0-438a-b91e-307b310fa052 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:16.270560 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d48f1-92b0-438a-b91e-307b310fa052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:16.270909 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d48f1-92b0-438a-b91e-307b310fa052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:16.271718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d48f1-92b0-438a-b91e-307b310fa052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:16.273435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d48f1-92b0-438a-b91e-307b310fa052 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:16.289238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1371/2732] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:16.290798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59ca67-1b68-4fbf-bd61-067f2e419f36 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:16.301899 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59ca67-1b68-4fbf-bd61-067f2e419f36 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:16.307143 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3863194-61b3-4a07-b08a-b3962b31547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:16.307913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3863194-61b3-4a07-b08a-b3962b31547f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:16.308280 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3863194-61b3-4a07-b08a-b3962b31547f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:16.308622 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3863194-61b3-4a07-b08a-b3962b31547f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:16.309456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3863194-61b3-4a07-b08a-b3962b31547f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:16.311140 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3863194-61b3-4a07-b08a-b3962b31547f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:16.322646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1362/2733] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:19:16.327020 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d48f1-92b0-438a-b91e-307b310fa052 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:16.338345 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d48f1-92b0-438a-b91e-307b310fa052 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:16.344152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978a510-376d-45cd-91a7-ebf6c6aed103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:16.345607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a510-376d-45cd-91a7-ebf6c6aed103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:16.345907 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a510-376d-45cd-91a7-ebf6c6aed103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:16.346193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a510-376d-45cd-91a7-ebf6c6aed103 admin admin] PATH_INFO: `/v3/projects/04a03a08ef9b4c22bc5d8a3abb55996b/users/13a8418f51bf4f0683b7c14a1ef2b92c/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:16.364037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978a510-376d-45cd-91a7-ebf6c6aed103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a03a08ef9b4c22bc5d8a3abb55996b, user_id=13a8418f51bf4f0683b7c14a1ef2b92c, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:16.367132 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978a510-376d-45cd-91a7-ebf6c6aed103 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:16.388503 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1372/2734] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:19:16 2022] PUT /identity/v3/projects/04a03a08ef9b4c22bc5d8a3abb55996b/users/13a8418f51bf4f0683b7c14a1ef2b92c/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:16.396995 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b098a27-41e2-46c5-ab9d-218f173846ab None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:16.397502 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b098a27-41e2-46c5-ab9d-218f173846ab None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:16.397809 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b098a27-41e2-46c5-ab9d-218f173846ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:16.432968 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7b098a27-41e2-46c5-ab9d-218f173846ab None None] MFA Rules not processed for user `13a8418f51bf4f0683b7c14a1ef2b92c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:16.434361 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7b098a27-41e2-46c5-ab9d-218f173846ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:16.507559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1363/2735] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:16.519402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978a510-376d-45cd-91a7-ebf6c6aed103 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:16.521065 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e978a510-376d-45cd-91a7-ebf6c6aed103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:16.620552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978a510-376d-45cd-91a7-ebf6c6aed103 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:16.625151 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1eab3-e59a-4f1e-a630-8665bddaa7df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:16.626076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1eab3-e59a-4f1e-a630-8665bddaa7df service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:16.626364 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1eab3-e59a-4f1e-a630-8665bddaa7df service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:16.626636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1eab3-e59a-4f1e-a630-8665bddaa7df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:16.637953 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1eab3-e59a-4f1e-a630-8665bddaa7df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:16.639773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1eab3-e59a-4f1e-a630-8665bddaa7df service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:16.650115 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1373/2736] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:17.034760 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff7342-7f19-4a87-ba6c-cbb4de6adf9d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:17.035049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff7342-7f19-4a87-ba6c-cbb4de6adf9d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:17.035382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff7342-7f19-4a87-ba6c-cbb4de6adf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:17.056164 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-19ff7342-7f19-4a87-ba6c-cbb4de6adf9d None None] MFA Rules not processed for user `eaec9bf261194c82b5d9b2b0fdd5c276`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:17.057695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-19ff7342-7f19-4a87-ba6c-cbb4de6adf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:17.121893 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1364/2737] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:18.126381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd2e24-56d2-4742-b0a6-907e6ff74d72 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:18.126835 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd2e24-56d2-4742-b0a6-907e6ff74d72 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:18.128292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd2e24-56d2-4742-b0a6-907e6ff74d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:18.144663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:18.152679 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2bfd2e24-56d2-4742-b0a6-907e6ff74d72 None None] MFA Rules not processed for user `13a8418f51bf4f0683b7c14a1ef2b92c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:18.156273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2bfd2e24-56d2-4742-b0a6-907e6ff74d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:18.174359 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1374/2738] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:22.511328 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff7342-7f19-4a87-ba6c-cbb4de6adf9d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:22.512874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-19ff7342-7f19-4a87-ba6c-cbb4de6adf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:22.611692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff7342-7f19-4a87-ba6c-cbb4de6adf9d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:22.617799 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64352160-8308-4047-9e76-d14411fd732e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:22.618612 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64352160-8308-4047-9e76-d14411fd732e service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:22.618894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64352160-8308-4047-9e76-d14411fd732e service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:22.619173 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64352160-8308-4047-9e76-d14411fd732e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:22.621260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-64352160-8308-4047-9e76-d14411fd732e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:22.636325 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64352160-8308-4047-9e76-d14411fd732e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:22.638360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64352160-8308-4047-9e76-d14411fd732e service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:22.645692 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:22.657073 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1365/2739] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:32.658536 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:34.917701 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f74e62-68ab-4afd-8583-02e5801c05ba None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:34.918253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f74e62-68ab-4afd-8583-02e5801c05ba None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:34.918253 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f74e62-68ab-4afd-8583-02e5801c05ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:34.940921 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b0f74e62-68ab-4afd-8583-02e5801c05ba None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:34.942200 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b0f74e62-68ab-4afd-8583-02e5801c05ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:35.002294 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1375/2740] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:19:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:35.055112 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64352160-8308-4047-9e76-d14411fd732e service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:35.056722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-64352160-8308-4047-9e76-d14411fd732e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:35.136783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64352160-8308-4047-9e76-d14411fd732e service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:35.142200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12030b-9e10-4bb9-89d2-b3335a9f1e0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:35.142849 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12030b-9e10-4bb9-89d2-b3335a9f1e0d service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:35.143128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12030b-9e10-4bb9-89d2-b3335a9f1e0d service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:35.143403 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12030b-9e10-4bb9-89d2-b3335a9f1e0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:35.151943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12030b-9e10-4bb9-89d2-b3335a9f1e0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:35.153591 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12030b-9e10-4bb9-89d2-b3335a9f1e0d service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:35.161788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1366/2741] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:19:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:19:35.716348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3c9fe-3787-42e1-a965-d47dd068d3a4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:35.716639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3c9fe-3787-42e1-a965-d47dd068d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:35.716919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3c9fe-3787-42e1-a965-d47dd068d3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:35.735685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-52e3c9fe-3787-42e1-a965-d47dd068d3a4 None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:35.737012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-52e3c9fe-3787-42e1-a965-d47dd068d3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:35.744850 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1376/2742] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 17 15:19:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:35.758362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12030b-9e10-4bb9-89d2-b3335a9f1e0d service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:35.769445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12030b-9e10-4bb9-89d2-b3335a9f1e0d service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:35.774791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb89f58-bc65-413b-a481-7732371eeee4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:35.775442 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb89f58-bc65-413b-a481-7732371eeee4 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:35.775780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb89f58-bc65-413b-a481-7732371eeee4 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:35.776064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb89f58-bc65-413b-a481-7732371eeee4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:35.785263 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb89f58-bc65-413b-a481-7732371eeee4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:35.786917 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb89f58-bc65-413b-a481-7732371eeee4 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:35.797043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1367/2743] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:19:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:19:36.006849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928994ff-d5c1-4c75-b7da-e7455653356c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:36.007380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928994ff-d5c1-4c75-b7da-e7455653356c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:36.007598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928994ff-d5c1-4c75-b7da-e7455653356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:36.026291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-928994ff-d5c1-4c75-b7da-e7455653356c None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:36.027611 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-928994ff-d5c1-4c75-b7da-e7455653356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:36.035596 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1377/2744] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 17 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:36.047765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb89f58-bc65-413b-a481-7732371eeee4 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:36.058678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb89f58-bc65-413b-a481-7732371eeee4 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:36.064060 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201f335-b04d-4c22-9310-c19c2a144a9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:36.064763 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201f335-b04d-4c22-9310-c19c2a144a9f service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:36.065041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201f335-b04d-4c22-9310-c19c2a144a9f service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:36.065353 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201f335-b04d-4c22-9310-c19c2a144a9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:36.074290 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201f335-b04d-4c22-9310-c19c2a144a9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:36.075928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201f335-b04d-4c22-9310-c19c2a144a9f service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:36.084655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1368/2745] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:19:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:19:36.426716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72944-946a-44b7-92e6-11a17b8f1475 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:36.426978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72944-946a-44b7-92e6-11a17b8f1475 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:36.427248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72944-946a-44b7-92e6-11a17b8f1475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:36.446375 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c7e72944-946a-44b7-92e6-11a17b8f1475 None None] MFA Rules not processed for user `0ad87047a3e94b89b28b51d50ed9b5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:36.447930 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c7e72944-946a-44b7-92e6-11a17b8f1475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:36.457088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1378/2746] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 17 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:36.469335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201f335-b04d-4c22-9310-c19c2a144a9f service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:36.480642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201f335-b04d-4c22-9310-c19c2a144a9f service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:36.486458 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb6c8c-090a-4d7b-a9dd-6e5f18a3a624 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34feb70a340c4fc5b1fad510328c009b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:36.487108 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb6c8c-090a-4d7b-a9dd-6e5f18a3a624 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:36.487389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb6c8c-090a-4d7b-a9dd-6e5f18a3a624 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:36.487665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb6c8c-090a-4d7b-a9dd-6e5f18a3a624 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:36.497427 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb6c8c-090a-4d7b-a9dd-6e5f18a3a624 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:36.499125 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb6c8c-090a-4d7b-a9dd-6e5f18a3a624 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:36.508835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1369/2747] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 17 15:19:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 15:19:38.644290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72944-946a-44b7-92e6-11a17b8f1475 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:38.714932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72944-946a-44b7-92e6-11a17b8f1475 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:38.720248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:38.721022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:38.721456 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:38.721769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] PATH_INFO: `/v3/users/13a8418f51bf4f0683b7c14a1ef2b92c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:38.723015 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a8418f51bf4f0683b7c14a1ef2b92c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:38.724959 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:38.777716 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a8418f51bf4f0683b7c14a1ef2b92c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:38.784833 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a8418f51bf4f0683b7c14a1ef2b92c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:38.785870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a8418f51bf4f0683b7c14a1ef2b92c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:38.796766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a8418f51bf4f0683b7c14a1ef2b92c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:38.797788 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a8418f51bf4f0683b7c14a1ef2b92c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:38.825091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1379/2748] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:19:38 2022] DELETE /identity/v3/users/13a8418f51bf4f0683b7c14a1ef2b92c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:38.830008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8750289-9e70-4585-83a2-094e2d3c1111 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:38.830499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8750289-9e70-4585-83a2-094e2d3c1111 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:38.830595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8750289-9e70-4585-83a2-094e2d3c1111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:38.848896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b8750289-9e70-4585-83a2-094e2d3c1111 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:19:38.850154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b8750289-9e70-4585-83a2-094e2d3c1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:38.910278 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1370/2749] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:19:38.920124 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:38.921773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:38.928852 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:38.991473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f5de-91d1-43e3-9209-b06d4d570204 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:38.995446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f6922-6215-485d-ab04-ab4e9e4e9267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:38.996102 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f6922-6215-485d-ab04-ab4e9e4e9267 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:38.996383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f6922-6215-485d-ab04-ab4e9e4e9267 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:38.996657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f6922-6215-485d-ab04-ab4e9e4e9267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:39.007511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f6922-6215-485d-ab04-ab4e9e4e9267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:39.008951 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f6922-6215-485d-ab04-ab4e9e4e9267 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:39.020410 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1380/2750] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:19:39.218456 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8750289-9e70-4585-83a2-094e2d3c1111 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:19:39.220010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b8750289-9e70-4585-83a2-094e2d3c1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:19:39.236267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8750289-9e70-4585-83a2-094e2d3c1111 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:19:39.241585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:19:39.242480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:19:39.242759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:19:39.243036 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] PATH_INFO: `/v3/projects/04a03a08ef9b4c22bc5d8a3abb55996b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:19:39.244252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a03a08ef9b4c22bc5d8a3abb55996b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:19:39.246351 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:19:39.295420 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:39.299863 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a03a08ef9b4c22bc5d8a3abb55996b', 'request_id': 'req-4b166574-0573-4b5d-acf3-e9ece0a532cf'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:39.306859 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a03a08ef9b4c22bc5d8a3abb55996b', 'request_id': 'req-4b166574-0573-4b5d-acf3-e9ece0a532cf'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:39.316597 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a03a08ef9b4c22bc5d8a3abb55996b', 'request_id': 'req-4b166574-0573-4b5d-acf3-e9ece0a532cf'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:39.329284 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] The token cache is being invalidate because project 04a03a08ef9b4c22bc5d8a3abb55996b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:19:39.329558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:39.330188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b166574-0573-4b5d-acf3-e9ece0a532cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:19:39.331794 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1371/2751] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:19:39 2022] DELETE /identity/v3/projects/04a03a08ef9b4c22bc5d8a3abb55996b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:19:49.015018 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=24 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:49.326595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:42.729079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f6922-6215-485d-ab04-ab4e9e4e9267 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:21:42.730796 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cc9f6922-6215-485d-ab04-ab4e9e4e9267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:21:42.807016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f6922-6215-485d-ab04-ab4e9e4e9267 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:21:42.869010 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03803b8f-2236-4e8b-82ee-f971047b73e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:21:42.869690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03803b8f-2236-4e8b-82ee-f971047b73e8 service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:21:42.869967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03803b8f-2236-4e8b-82ee-f971047b73e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:21:42.870238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03803b8f-2236-4e8b-82ee-f971047b73e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:21:42.872144 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-03803b8f-2236-4e8b-82ee-f971047b73e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:21:42.884426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03803b8f-2236-4e8b-82ee-f971047b73e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:21:42.886070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03803b8f-2236-4e8b-82ee-f971047b73e8 service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:21:42.896001 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1381/2752] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:21:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:21:46.860630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770d87a-8b45-42e0-8160-0a6dd99ccc8b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:21:46.861173 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770d87a-8b45-42e0-8160-0a6dd99ccc8b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:21:46.861358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770d87a-8b45-42e0-8160-0a6dd99ccc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:21:46.880892 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c770d87a-8b45-42e0-8160-0a6dd99ccc8b None None] MFA Rules not processed for user `eaec9bf261194c82b5d9b2b0fdd5c276`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:21:46.882194 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c770d87a-8b45-42e0-8160-0a6dd99ccc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:21:46.947831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1372/2753] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:21:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:21:47.283378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03803b8f-2236-4e8b-82ee-f971047b73e8 service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:21:47.284999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-03803b8f-2236-4e8b-82ee-f971047b73e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:21:47.345196 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03803b8f-2236-4e8b-82ee-f971047b73e8 service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:21:47.349718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ed94d-8a1d-47ad-af05-12b518c45985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:21:47.350391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed94d-8a1d-47ad-af05-12b518c45985 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:21:47.350670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed94d-8a1d-47ad-af05-12b518c45985 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:21:47.351030 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed94d-8a1d-47ad-af05-12b518c45985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:21:47.353235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8d3ed94d-8a1d-47ad-af05-12b518c45985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:21:47.363358 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ed94d-8a1d-47ad-af05-12b518c45985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:21:47.364846 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ed94d-8a1d-47ad-af05-12b518c45985 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:21:47.373026 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1382/2754] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:21:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:21:56.936977 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=25 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:57.369593 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:33.346316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770d87a-8b45-42e0-8160-0a6dd99ccc8b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:33.347996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c770d87a-8b45-42e0-8160-0a6dd99ccc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:33.407641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770d87a-8b45-42e0-8160-0a6dd99ccc8b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:33.411686 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780771-ad75-4fd6-84c7-09b8c32fa7b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:33.412327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780771-ad75-4fd6-84c7-09b8c32fa7b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:33.412608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780771-ad75-4fd6-84c7-09b8c32fa7b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:33.412886 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780771-ad75-4fd6-84c7-09b8c32fa7b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:33.414952 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-de780771-ad75-4fd6-84c7-09b8c32fa7b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:33.500499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de780771-ad75-4fd6-84c7-09b8c32fa7b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:33.501905 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de780771-ad75-4fd6-84c7-09b8c32fa7b0 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:33.513050 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1373/2755] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:22:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:22:36.272160 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ed94d-8a1d-47ad-af05-12b518c45985 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:36.283128 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ed94d-8a1d-47ad-af05-12b518c45985 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:36.287913 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc7a8-17b0-4f81-9cf1-0214735bc3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:36.288558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc7a8-17b0-4f81-9cf1-0214735bc3dd service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:36.288841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc7a8-17b0-4f81-9cf1-0214735bc3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:36.289113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc7a8-17b0-4f81-9cf1-0214735bc3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:36.291405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-28adc7a8-17b0-4f81-9cf1-0214735bc3dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:36.306769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adc7a8-17b0-4f81-9cf1-0214735bc3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:36.308195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adc7a8-17b0-4f81-9cf1-0214735bc3dd service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:36.320636 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1383/2756] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:22:43.508388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=54 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:46.314586 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:50.475331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780771-ad75-4fd6-84c7-09b8c32fa7b0 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:50.476957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-de780771-ad75-4fd6-84c7-09b8c32fa7b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:50.544256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780771-ad75-4fd6-84c7-09b8c32fa7b0 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:50.549418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:50.550332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:50.550600 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:50.550878 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] PATH_INFO: `/v3/users/eaec9bf261194c82b5d9b2b0fdd5c276` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:50.552089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaec9bf261194c82b5d9b2b0fdd5c276)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:50.554055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:50.605312 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaec9bf261194c82b5d9b2b0fdd5c276'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:50.612929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaec9bf261194c82b5d9b2b0fdd5c276'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:50.613712 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaec9bf261194c82b5d9b2b0fdd5c276'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:50.624094 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaec9bf261194c82b5d9b2b0fdd5c276'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:50.637068 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f97943af-e1da-499d-8131-fcc3fb6cbd26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaec9bf261194c82b5d9b2b0fdd5c276'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:50.643283 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1374/2757] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:22:50 2022] DELETE /identity/v3/users/eaec9bf261194c82b5d9b2b0fdd5c276 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:50.842419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc7a8-17b0-4f81-9cf1-0214735bc3dd service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:50.854067 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc7a8-17b0-4f81-9cf1-0214735bc3dd service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:50.925287 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:50.926212 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:50.926486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:50.926758 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] PATH_INFO: `/v3/projects/124bab10dd2f484ab0315edaa3fcf17f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:50.928021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] RBAC: Authorizing `identity:delete_project(project_id=124bab10dd2f484ab0315edaa3fcf17f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:50.930291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:50.979563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124bab10dd2f484ab0315edaa3fcf17f', 'request_id': 'req-49e7404b-6902-42c7-af50-74681b57719f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:50.985751 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124bab10dd2f484ab0315edaa3fcf17f', 'request_id': 'req-49e7404b-6902-42c7-af50-74681b57719f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:50.995510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124bab10dd2f484ab0315edaa3fcf17f', 'request_id': 'req-49e7404b-6902-42c7-af50-74681b57719f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:51.006598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] The token cache is being invalidate because project 124bab10dd2f484ab0315edaa3fcf17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:22:51.006881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:51.007510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49e7404b-6902-42c7-af50-74681b57719f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:51.009087 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1384/2758] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:22:50 2022] DELETE /identity/v3/projects/124bab10dd2f484ab0315edaa3fcf17f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:51.014142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88da99f-0328-4a20-8c5a-d08ab3340fc7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:51.014433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88da99f-0328-4a20-8c5a-d08ab3340fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:51.014711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88da99f-0328-4a20-8c5a-d08ab3340fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:51.033248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d88da99f-0328-4a20-8c5a-d08ab3340fc7 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:51.034479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d88da99f-0328-4a20-8c5a-d08ab3340fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:51.100376 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1375/2759] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:51.108460 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aad6a-8aad-4a2b-aec8-80a9fc3c550e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:51.108747 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aad6a-8aad-4a2b-aec8-80a9fc3c550e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:51.109024 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aad6a-8aad-4a2b-aec8-80a9fc3c550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:51.128717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d66aad6a-8aad-4a2b-aec8-80a9fc3c550e None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:51.130008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d66aad6a-8aad-4a2b-aec8-80a9fc3c550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:51.139348 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1385/2760] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:22:51.143698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88da99f-0328-4a20-8c5a-d08ab3340fc7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:51.154928 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88da99f-0328-4a20-8c5a-d08ab3340fc7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:51.160645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608db68-19cb-4a8a-ac90-a5c2096a7616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:51.161336 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608db68-19cb-4a8a-ac90-a5c2096a7616 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:51.161625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608db68-19cb-4a8a-ac90-a5c2096a7616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:51.161902 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608db68-19cb-4a8a-ac90-a5c2096a7616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:51.162703 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608db68-19cb-4a8a-ac90-a5c2096a7616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:22:51.163010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608db68-19cb-4a8a-ac90-a5c2096a7616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:51.165479 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608db68-19cb-4a8a-ac90-a5c2096a7616 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:51.177740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1376/2761] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:22:51.183858 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aad6a-8aad-4a2b-aec8-80a9fc3c550e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:51.193529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aad6a-8aad-4a2b-aec8-80a9fc3c550e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:51.199549 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc4a46-fa88-4946-aa2e-8d37c3f6587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:51.200199 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc4a46-fa88-4946-aa2e-8d37c3f6587c admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:51.200477 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc4a46-fa88-4946-aa2e-8d37c3f6587c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:51.200752 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc4a46-fa88-4946-aa2e-8d37c3f6587c admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:51.201481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc4a46-fa88-4946-aa2e-8d37c3f6587c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:51.203365 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc4a46-fa88-4946-aa2e-8d37c3f6587c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:51.230864 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1386/2762] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:22:51 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:22:51.235011 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608db68-19cb-4a8a-ac90-a5c2096a7616 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:51.246579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608db68-19cb-4a8a-ac90-a5c2096a7616 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:51.250927 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:51.307606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccdfcf-db11-4f8e-95ab-92bbe01661eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:51.308271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccdfcf-db11-4f8e-95ab-92bbe01661eb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:51.308547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccdfcf-db11-4f8e-95ab-92bbe01661eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:51.308818 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccdfcf-db11-4f8e-95ab-92bbe01661eb admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:51.309559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccdfcf-db11-4f8e-95ab-92bbe01661eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:51.311473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccdfcf-db11-4f8e-95ab-92bbe01661eb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:51.334166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1377/2763] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:22:51 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:22:51.338493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc4a46-fa88-4946-aa2e-8d37c3f6587c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:51.350084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc4a46-fa88-4946-aa2e-8d37c3f6587c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:51.356493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881f760-2633-4c35-a8e6-ea8b907292fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:51.357158 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881f760-2633-4c35-a8e6-ea8b907292fa admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:51.357445 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881f760-2633-4c35-a8e6-ea8b907292fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:51.357717 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881f760-2633-4c35-a8e6-ea8b907292fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:51.358441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881f760-2633-4c35-a8e6-ea8b907292fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:51.360042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881f760-2633-4c35-a8e6-ea8b907292fa admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:51.370997 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1387/2764] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:51.375562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccdfcf-db11-4f8e-95ab-92bbe01661eb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:51.388611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccdfcf-db11-4f8e-95ab-92bbe01661eb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:51.393832 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847058e-878a-4885-be35-3cbb90cf9cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:51.394498 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847058e-878a-4885-be35-3cbb90cf9cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:51.394781 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847058e-878a-4885-be35-3cbb90cf9cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:51.395057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847058e-878a-4885-be35-3cbb90cf9cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:51.395820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847058e-878a-4885-be35-3cbb90cf9cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:51.397522 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847058e-878a-4885-be35-3cbb90cf9cbb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:51.407907 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1378/2765] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:51.412091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881f760-2633-4c35-a8e6-ea8b907292fa admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:51.422268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881f760-2633-4c35-a8e6-ea8b907292fa admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:51.427335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18ff68-2a2f-462d-b52e-5c15ab6d59c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:51.428220 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18ff68-2a2f-462d-b52e-5c15ab6d59c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:51.428496 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18ff68-2a2f-462d-b52e-5c15ab6d59c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:51.428766 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18ff68-2a2f-462d-b52e-5c15ab6d59c7 admin admin] PATH_INFO: `/v3/projects/49ebde7c6496425dac1da95140e9b828/users/8bf9f255cec74cd893ecefea3a9ca363/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:51.443400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18ff68-2a2f-462d-b52e-5c15ab6d59c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ebde7c6496425dac1da95140e9b828, user_id=8bf9f255cec74cd893ecefea3a9ca363, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:51.446479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18ff68-2a2f-462d-b52e-5c15ab6d59c7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:51.462141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1388/2766] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:22:51 2022] PUT /identity/v3/projects/49ebde7c6496425dac1da95140e9b828/users/8bf9f255cec74cd893ecefea3a9ca363/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:51.468232 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419928-24fd-4d67-b7b7-bab637d7b50f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:51.468608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419928-24fd-4d67-b7b7-bab637d7b50f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:51.469019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419928-24fd-4d67-b7b7-bab637d7b50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:51.490471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-78419928-24fd-4d67-b7b7-bab637d7b50f None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:51.491683 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-78419928-24fd-4d67-b7b7-bab637d7b50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:51.558681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1379/2767] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:51.568400 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18ff68-2a2f-462d-b52e-5c15ab6d59c7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:51.570574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cf18ff68-2a2f-462d-b52e-5c15ab6d59c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:51.609633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:51.638890 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18ff68-2a2f-462d-b52e-5c15ab6d59c7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:51.643304 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327630c0-23ce-4ebf-8222-71091ba7c637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:51.644084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327630c0-23ce-4ebf-8222-71091ba7c637 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:51.644392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327630c0-23ce-4ebf-8222-71091ba7c637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:51.644795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327630c0-23ce-4ebf-8222-71091ba7c637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:51.654946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327630c0-23ce-4ebf-8222-71091ba7c637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:51.656409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327630c0-23ce-4ebf-8222-71091ba7c637 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:51.666590 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1389/2768] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:22:52.570295 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e50dc1-4aba-4e63-9061-5e263c64234c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:52.570900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e50dc1-4aba-4e63-9061-5e263c64234c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:52.570900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e50dc1-4aba-4e63-9061-5e263c64234c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:52.600568 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-43e50dc1-4aba-4e63-9061-5e263c64234c None None] MFA Rules not processed for user `8bf9f255cec74cd893ecefea3a9ca363`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:52.601877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-43e50dc1-4aba-4e63-9061-5e263c64234c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:52.678192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1380/2769] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:52.682730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327630c0-23ce-4ebf-8222-71091ba7c637 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:52.693276 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327630c0-23ce-4ebf-8222-71091ba7c637 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:52.698641 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4904f96-d12f-4927-b759-1ce0639de4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:52.699374 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4904f96-d12f-4927-b759-1ce0639de4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:52.699863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4904f96-d12f-4927-b759-1ce0639de4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:52.700204 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4904f96-d12f-4927-b759-1ce0639de4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:52.700986 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4904f96-d12f-4927-b759-1ce0639de4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:52.703002 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4904f96-d12f-4927-b759-1ce0639de4f0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:52.733163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1390/2770] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:22:52 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:22:52.737460 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e50dc1-4aba-4e63-9061-5e263c64234c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:52.753394 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e50dc1-4aba-4e63-9061-5e263c64234c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:52.768871 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:52.820339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaba87d-6228-4b0b-b91c-500dcdf6e6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:52.821241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba87d-6228-4b0b-b91c-500dcdf6e6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:52.821620 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba87d-6228-4b0b-b91c-500dcdf6e6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:52.822016 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba87d-6228-4b0b-b91c-500dcdf6e6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:52.822780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaba87d-6228-4b0b-b91c-500dcdf6e6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:52.824809 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaba87d-6228-4b0b-b91c-500dcdf6e6d5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:52.849526 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1381/2771] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:22:52 2022] POST /identity/v3/users => generated 308 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:22:52.850843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4904f96-d12f-4927-b759-1ce0639de4f0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:52.862076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4904f96-d12f-4927-b759-1ce0639de4f0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:52.867715 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0268b-e610-46e5-9710-a201c555653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:52.868423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0268b-e610-46e5-9710-a201c555653b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:52.868714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0268b-e610-46e5-9710-a201c555653b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:52.868976 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0268b-e610-46e5-9710-a201c555653b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:52.869753 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0268b-e610-46e5-9710-a201c555653b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:52.871351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0268b-e610-46e5-9710-a201c555653b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:52.886892 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1391/2772] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:52.888130 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaba87d-6228-4b0b-b91c-500dcdf6e6d5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:52.899387 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaba87d-6228-4b0b-b91c-500dcdf6e6d5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:52.904680 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e15fa0-a8f0-424a-95fa-96a0bd4415df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:52.905615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e15fa0-a8f0-424a-95fa-96a0bd4415df admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:52.905896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e15fa0-a8f0-424a-95fa-96a0bd4415df admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:52.906169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e15fa0-a8f0-424a-95fa-96a0bd4415df admin admin] PATH_INFO: `/v3/projects/1654965a40bd435e96fe1031a506d116/users/58037719e43241899d319d4e1b3fc20f/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:52.922537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e15fa0-a8f0-424a-95fa-96a0bd4415df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1654965a40bd435e96fe1031a506d116, user_id=58037719e43241899d319d4e1b3fc20f, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:52.925384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e15fa0-a8f0-424a-95fa-96a0bd4415df admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:52.944115 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1382/2773] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:22:52 2022] PUT /identity/v3/projects/1654965a40bd435e96fe1031a506d116/users/58037719e43241899d319d4e1b3fc20f/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:52.949336 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0268b-e610-46e5-9710-a201c555653b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:52.959974 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0268b-e610-46e5-9710-a201c555653b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:53.018942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92076dd-14ce-4538-bd82-19e7ca69734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:53.019617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92076dd-14ce-4538-bd82-19e7ca69734b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:53.019900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92076dd-14ce-4538-bd82-19e7ca69734b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:53.020179 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92076dd-14ce-4538-bd82-19e7ca69734b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:53.020901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92076dd-14ce-4538-bd82-19e7ca69734b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:53.022542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92076dd-14ce-4538-bd82-19e7ca69734b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:53.032868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1392/2774] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:53.037248 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e15fa0-a8f0-424a-95fa-96a0bd4415df admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:53.047961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e15fa0-a8f0-424a-95fa-96a0bd4415df admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:53.052872 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a9de6-2063-4b51-9498-d968b13bda67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:53.053788 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9de6-2063-4b51-9498-d968b13bda67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:53.054064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9de6-2063-4b51-9498-d968b13bda67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:53.054337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9de6-2063-4b51-9498-d968b13bda67 admin admin] PATH_INFO: `/v3/projects/1654965a40bd435e96fe1031a506d116/users/58037719e43241899d319d4e1b3fc20f/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:53.056663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a9de6-2063-4b51-9498-d968b13bda67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1654965a40bd435e96fe1031a506d116, user_id=58037719e43241899d319d4e1b3fc20f, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:53.059339 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a9de6-2063-4b51-9498-d968b13bda67 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:53.071020 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1383/2775] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:22:53 2022] PUT /identity/v3/projects/1654965a40bd435e96fe1031a506d116/users/58037719e43241899d319d4e1b3fc20f/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:53.730250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e52ae-0d99-4064-9493-816b6f7914aa None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:53.730844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e52ae-0d99-4064-9493-816b6f7914aa None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:53.730844 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e52ae-0d99-4064-9493-816b6f7914aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:53.758184 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-290e52ae-0d99-4064-9493-816b6f7914aa None None] MFA Rules not processed for user `58037719e43241899d319d4e1b3fc20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:53.759518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-290e52ae-0d99-4064-9493-816b6f7914aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:53.844071 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1393/2776] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:54.342183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a9de6-2063-4b51-9498-d968b13bda67 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:54.344137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5e3a9de6-2063-4b51-9498-d968b13bda67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:54.426538 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a9de6-2063-4b51-9498-d968b13bda67 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:54.431945 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b793e2-c4da-49c7-b3fd-bb1a0291be9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:54.432603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b793e2-c4da-49c7-b3fd-bb1a0291be9a service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:54.432895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b793e2-c4da-49c7-b3fd-bb1a0291be9a service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:54.433179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b793e2-c4da-49c7-b3fd-bb1a0291be9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:54.435042 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e9b793e2-c4da-49c7-b3fd-bb1a0291be9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:54.447377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b793e2-c4da-49c7-b3fd-bb1a0291be9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:54.449002 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b793e2-c4da-49c7-b3fd-bb1a0291be9a service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:54.460318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1384/2777] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:22:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:22:54.956281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e52ae-0d99-4064-9493-816b6f7914aa None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:54.976870 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:55.020109 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e52ae-0d99-4064-9493-816b6f7914aa None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:55.025280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:55.026156 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:55.026433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:55.026704 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] PATH_INFO: `/v3/users/8bf9f255cec74cd893ecefea3a9ca363` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:55.027903 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf9f255cec74cd893ecefea3a9ca363)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:55.029897 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:55.077558 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf9f255cec74cd893ecefea3a9ca363'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.084439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf9f255cec74cd893ecefea3a9ca363'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.085146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf9f255cec74cd893ecefea3a9ca363'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.096893 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf9f255cec74cd893ecefea3a9ca363'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.097529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf9f255cec74cd893ecefea3a9ca363'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.115037 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1394/2778] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:22:54 2022] DELETE /identity/v3/users/8bf9f255cec74cd893ecefea3a9ca363 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:55.298820 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b793e2-c4da-49c7-b3fd-bb1a0291be9a service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:55.313724 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b793e2-c4da-49c7-b3fd-bb1a0291be9a service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:55.367415 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:55.374606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:55.375706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:55.376155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:55.376524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] PATH_INFO: `/v3/projects/49ebde7c6496425dac1da95140e9b828` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:55.377965 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ebde7c6496425dac1da95140e9b828)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:55.379914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:55.427122 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ebde7c6496425dac1da95140e9b828', 'request_id': 'req-50bb118b-1dab-4f2d-9d89-13ac39226f88'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.433548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ebde7c6496425dac1da95140e9b828', 'request_id': 'req-50bb118b-1dab-4f2d-9d89-13ac39226f88'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.443646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ebde7c6496425dac1da95140e9b828', 'request_id': 'req-50bb118b-1dab-4f2d-9d89-13ac39226f88'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.455205 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] The token cache is being invalidate because project 49ebde7c6496425dac1da95140e9b828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:22:55.455471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.456107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.457710 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1385/2779] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:22:55 2022] DELETE /identity/v3/projects/49ebde7c6496425dac1da95140e9b828 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:55.461996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:55.463599 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:55.477409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39dd92-adcb-41dd-a506-433f304a1f0d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:55.546391 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:55.547290 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:55.547581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:55.547886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] PATH_INFO: `/v3/users/58037719e43241899d319d4e1b3fc20f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:55.549143 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58037719e43241899d319d4e1b3fc20f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:55.551098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:55.597905 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:55.604381 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58037719e43241899d319d4e1b3fc20f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.611996 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58037719e43241899d319d4e1b3fc20f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.612643 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58037719e43241899d319d4e1b3fc20f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.621780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58037719e43241899d319d4e1b3fc20f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.622412 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-07bbb6b4-0788-4df0-a375-348efd861b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58037719e43241899d319d4e1b3fc20f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.642797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1395/2780] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:22:55 2022] DELETE /identity/v3/users/58037719e43241899d319d4e1b3fc20f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:55.838634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:55.840377 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:55.857740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb118b-1dab-4f2d-9d89-13ac39226f88 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:55.918431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:55.919728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:55.920148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:55.920559 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] PATH_INFO: `/v3/projects/1654965a40bd435e96fe1031a506d116` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:55.922417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1654965a40bd435e96fe1031a506d116)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:55.925440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:55.985824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1654965a40bd435e96fe1031a506d116', 'request_id': 'req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:55.992378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1654965a40bd435e96fe1031a506d116', 'request_id': 'req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:56.001089 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1654965a40bd435e96fe1031a506d116', 'request_id': 'req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:56.011996 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] The token cache is being invalidate because project 1654965a40bd435e96fe1031a506d116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:22:56.012279 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:56.012891 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-97a8e4d7-5f17-404e-9ccc-e31bdca5b1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:56.014478 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1386/2781] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:22:55 2022] DELETE /identity/v3/projects/1654965a40bd435e96fe1031a506d116 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:56.021566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a334093-f4bf-4613-a8fa-3f1330c9bb91 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.022112 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a334093-f4bf-4613-a8fa-3f1330c9bb91 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.022262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a334093-f4bf-4613-a8fa-3f1330c9bb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.042344 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0a334093-f4bf-4613-a8fa-3f1330c9bb91 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:56.043632 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0a334093-f4bf-4613-a8fa-3f1330c9bb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:56.106165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1396/2782] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:56.114793 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fae7d-4c46-45fe-9a8e-40c303449d69 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.115084 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fae7d-4c46-45fe-9a8e-40c303449d69 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.115366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fae7d-4c46-45fe-9a8e-40c303449d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.144717 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9c8fae7d-4c46-45fe-9a8e-40c303449d69 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:56.146422 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9c8fae7d-4c46-45fe-9a8e-40c303449d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:56.157759 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1387/2783] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:56.162379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a334093-f4bf-4613-a8fa-3f1330c9bb91 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.173754 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a334093-f4bf-4613-a8fa-3f1330c9bb91 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:56.179521 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f3768-f236-4529-afb9-a28aef4e59ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:56.180165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f3768-f236-4529-afb9-a28aef4e59ae admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.180479 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f3768-f236-4529-afb9-a28aef4e59ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.180757 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f3768-f236-4529-afb9-a28aef4e59ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.181528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f3768-f236-4529-afb9-a28aef4e59ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:22:56.181834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f3768-f236-4529-afb9-a28aef4e59ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:56.183467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f3768-f236-4529-afb9-a28aef4e59ae admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:56.196478 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1397/2784] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:22:56.202198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fae7d-4c46-45fe-9a8e-40c303449d69 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.211883 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fae7d-4c46-45fe-9a8e-40c303449d69 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:56.217691 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f27a5-e059-461a-a240-bcab8fccc483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:56.218345 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f27a5-e059-461a-a240-bcab8fccc483 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.218624 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f27a5-e059-461a-a240-bcab8fccc483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.218894 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f27a5-e059-461a-a240-bcab8fccc483 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.219589 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f27a5-e059-461a-a240-bcab8fccc483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:56.221560 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f27a5-e059-461a-a240-bcab8fccc483 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:56.230429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:56.254740 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1388/2785] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:22:56 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:22:56.259604 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f3768-f236-4529-afb9-a28aef4e59ae admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.269999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f3768-f236-4529-afb9-a28aef4e59ae admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:56.328292 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240111d-cb48-4535-94a4-5ab9260e1a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:56.328868 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240111d-cb48-4535-94a4-5ab9260e1a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.329146 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240111d-cb48-4535-94a4-5ab9260e1a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.329449 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240111d-cb48-4535-94a4-5ab9260e1a43 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.330162 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240111d-cb48-4535-94a4-5ab9260e1a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:56.332133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240111d-cb48-4535-94a4-5ab9260e1a43 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:56.363645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1398/2786] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:22:56 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:22:56.370044 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f27a5-e059-461a-a240-bcab8fccc483 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.380630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f27a5-e059-461a-a240-bcab8fccc483 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:56.386298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439f1e8-9adf-4bbd-be7c-5914fe98f617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:56.386963 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439f1e8-9adf-4bbd-be7c-5914fe98f617 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.387245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439f1e8-9adf-4bbd-be7c-5914fe98f617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.387524 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439f1e8-9adf-4bbd-be7c-5914fe98f617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.388264 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439f1e8-9adf-4bbd-be7c-5914fe98f617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:56.389940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439f1e8-9adf-4bbd-be7c-5914fe98f617 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:56.401662 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1389/2787] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:56.405706 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240111d-cb48-4535-94a4-5ab9260e1a43 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.416985 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240111d-cb48-4535-94a4-5ab9260e1a43 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:56.421712 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee62354-26b8-473a-a33d-335a96097aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:56.422378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee62354-26b8-473a-a33d-335a96097aec admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.422661 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee62354-26b8-473a-a33d-335a96097aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.422936 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee62354-26b8-473a-a33d-335a96097aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.423663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee62354-26b8-473a-a33d-335a96097aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:56.425286 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee62354-26b8-473a-a33d-335a96097aec admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:56.436342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1399/2788] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:56.441363 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439f1e8-9adf-4bbd-be7c-5914fe98f617 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.453530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439f1e8-9adf-4bbd-be7c-5914fe98f617 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:56.460142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb300e-f529-4131-a66d-605a629a17e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:56.461019 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb300e-f529-4131-a66d-605a629a17e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.461323 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb300e-f529-4131-a66d-605a629a17e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.461643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb300e-f529-4131-a66d-605a629a17e0 admin admin] PATH_INFO: `/v3/projects/80044425991f4b76835621c883b8dcb1/users/a220914d58504f5f846f28abf9bff36f/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.480543 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb300e-f529-4131-a66d-605a629a17e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80044425991f4b76835621c883b8dcb1, user_id=a220914d58504f5f846f28abf9bff36f, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:56.483207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb300e-f529-4131-a66d-605a629a17e0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:56.500970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1390/2789] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:22:56 2022] PUT /identity/v3/projects/80044425991f4b76835621c883b8dcb1/users/a220914d58504f5f846f28abf9bff36f/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:56.513559 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63572f-f735-4294-88da-af7b9bbfabb0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.513973 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63572f-f735-4294-88da-af7b9bbfabb0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.514351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63572f-f735-4294-88da-af7b9bbfabb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.546614 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-eb63572f-f735-4294-88da-af7b9bbfabb0 None None] MFA Rules not processed for user `a220914d58504f5f846f28abf9bff36f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:56.547819 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-eb63572f-f735-4294-88da-af7b9bbfabb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:56.557514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:56.620057 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1400/2790] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:56.626851 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb300e-f529-4131-a66d-605a629a17e0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.700378 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb300e-f529-4131-a66d-605a629a17e0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:56.706541 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52578a41-ae71-40d0-a39d-53ff50c5f014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:56.707236 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52578a41-ae71-40d0-a39d-53ff50c5f014 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.707513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52578a41-ae71-40d0-a39d-53ff50c5f014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.707780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52578a41-ae71-40d0-a39d-53ff50c5f014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.708481 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52578a41-ae71-40d0-a39d-53ff50c5f014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:56.710436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52578a41-ae71-40d0-a39d-53ff50c5f014 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:56.742299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1391/2791] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:22:56 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:22:56.746882 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63572f-f735-4294-88da-af7b9bbfabb0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.757869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63572f-f735-4294-88da-af7b9bbfabb0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:56.819048 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a414-272a-428b-8c0d-380cbdca5cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:56.819739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a414-272a-428b-8c0d-380cbdca5cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.820340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a414-272a-428b-8c0d-380cbdca5cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.820616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a414-272a-428b-8c0d-380cbdca5cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.821486 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7a414-272a-428b-8c0d-380cbdca5cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:56.823482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7a414-272a-428b-8c0d-380cbdca5cb6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:56.849351 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1401/2792] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:22:56 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:22:56.853867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52578a41-ae71-40d0-a39d-53ff50c5f014 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.864625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52578a41-ae71-40d0-a39d-53ff50c5f014 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:56.870700 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89898c4-4670-4cb8-8a12-287d150aee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:56.871366 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89898c4-4670-4cb8-8a12-287d150aee86 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.871642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89898c4-4670-4cb8-8a12-287d150aee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.871914 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89898c4-4670-4cb8-8a12-287d150aee86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.872641 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89898c4-4670-4cb8-8a12-287d150aee86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:56.874292 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89898c4-4670-4cb8-8a12-287d150aee86 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:56.886644 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1392/2793] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:56.893307 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a414-272a-428b-8c0d-380cbdca5cb6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.906622 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a414-272a-428b-8c0d-380cbdca5cb6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:56.912685 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f4d35-98de-43c4-8be8-65cbbe2c8cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:56.913603 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f4d35-98de-43c4-8be8-65cbbe2c8cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:56.913881 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f4d35-98de-43c4-8be8-65cbbe2c8cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:56.914154 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f4d35-98de-43c4-8be8-65cbbe2c8cbf admin admin] PATH_INFO: `/v3/projects/4c7e41e93bdd4e4b86a4d5128433c85d/users/b51a07f280714239b694206c68a3409a/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:56.932168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f4d35-98de-43c4-8be8-65cbbe2c8cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7e41e93bdd4e4b86a4d5128433c85d, user_id=b51a07f280714239b694206c68a3409a, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:56.936379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f4d35-98de-43c4-8be8-65cbbe2c8cbf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:56.958729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1402/2794] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:22:56 2022] PUT /identity/v3/projects/4c7e41e93bdd4e4b86a4d5128433c85d/users/b51a07f280714239b694206c68a3409a/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:56.964212 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89898c4-4670-4cb8-8a12-287d150aee86 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:56.975234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89898c4-4670-4cb8-8a12-287d150aee86 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:57.038221 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb87f6-fd82-48e8-949c-22395e3a4335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:57.038883 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb87f6-fd82-48e8-949c-22395e3a4335 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:57.039202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb87f6-fd82-48e8-949c-22395e3a4335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:57.039474 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb87f6-fd82-48e8-949c-22395e3a4335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:57.040212 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb87f6-fd82-48e8-949c-22395e3a4335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:57.041855 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb87f6-fd82-48e8-949c-22395e3a4335 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:57.051833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1393/2795] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:57.056288 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f4d35-98de-43c4-8be8-65cbbe2c8cbf admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:57.067182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f4d35-98de-43c4-8be8-65cbbe2c8cbf admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:57.072410 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4550a-debf-4440-885c-964662321d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:57.073360 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4550a-debf-4440-885c-964662321d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:57.073633 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4550a-debf-4440-885c-964662321d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:57.073911 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4550a-debf-4440-885c-964662321d5e admin admin] PATH_INFO: `/v3/projects/4c7e41e93bdd4e4b86a4d5128433c85d/users/b51a07f280714239b694206c68a3409a/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:57.076051 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4550a-debf-4440-885c-964662321d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7e41e93bdd4e4b86a4d5128433c85d, user_id=b51a07f280714239b694206c68a3409a, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:57.078719 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4550a-debf-4440-885c-964662321d5e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:57.089789 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1403/2796] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:22:57 2022] PUT /identity/v3/projects/4c7e41e93bdd4e4b86a4d5128433c85d/users/b51a07f280714239b694206c68a3409a/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:57.100154 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad5f4-ea4b-4f59-8adf-7f307e39e10c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:57.100470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad5f4-ea4b-4f59-8adf-7f307e39e10c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:57.100747 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad5f4-ea4b-4f59-8adf-7f307e39e10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:57.130616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-732ad5f4-ea4b-4f59-8adf-7f307e39e10c None None] MFA Rules not processed for user `b51a07f280714239b694206c68a3409a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:57.132065 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-732ad5f4-ea4b-4f59-8adf-7f307e39e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:57.145001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:57.207722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1394/2797] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:57.219490 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4550a-debf-4440-885c-964662321d5e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:57.221405 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e7a4550a-debf-4440-885c-964662321d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:57.293013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4550a-debf-4440-885c-964662321d5e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:57.297795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb17c5-c87e-46ef-bb29-3a9aaf7bd16b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:57.298447 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb17c5-c87e-46ef-bb29-3a9aaf7bd16b service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:57.298733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb17c5-c87e-46ef-bb29-3a9aaf7bd16b service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:57.299008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb17c5-c87e-46ef-bb29-3a9aaf7bd16b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:57.309542 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb17c5-c87e-46ef-bb29-3a9aaf7bd16b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:57.310978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb17c5-c87e-46ef-bb29-3a9aaf7bd16b service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:57.321644 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1404/2798] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:22:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:22:57.353592 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ad5f4-ea4b-4f59-8adf-7f307e39e10c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:57.417327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ad5f4-ea4b-4f59-8adf-7f307e39e10c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:57.423548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:57.424838 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:57.425271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:57.425652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] PATH_INFO: `/v3/users/a220914d58504f5f846f28abf9bff36f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:57.427831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a220914d58504f5f846f28abf9bff36f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:57.430956 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:57.489437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a220914d58504f5f846f28abf9bff36f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:57.496780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a220914d58504f5f846f28abf9bff36f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:57.497429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a220914d58504f5f846f28abf9bff36f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:57.506267 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a220914d58504f5f846f28abf9bff36f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:57.518885 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a220914d58504f5f846f28abf9bff36f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:57.525195 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1395/2799] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:22:57 2022] DELETE /identity/v3/users/a220914d58504f5f846f28abf9bff36f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:57.529963 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f069574-0eb5-4ca6-8150-9ec789254faf None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:57.530254 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f069574-0eb5-4ca6-8150-9ec789254faf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:57.530533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f069574-0eb5-4ca6-8150-9ec789254faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:57.542933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:57.548889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9f069574-0eb5-4ca6-8150-9ec789254faf None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:57.550678 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9f069574-0eb5-4ca6-8150-9ec789254faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:57.610995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1405/2800] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:22:57.621298 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:57.622874 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:57.658466 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:57.692062 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e432-1d60-49fc-8567-ef9c8a0e5f40 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:57.697594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12cfb-2618-46a6-bb0f-d0fe21a82053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:57.698245 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12cfb-2618-46a6-bb0f-d0fe21a82053 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:57.698530 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12cfb-2618-46a6-bb0f-d0fe21a82053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:57.698804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12cfb-2618-46a6-bb0f-d0fe21a82053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:57.708753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f12cfb-2618-46a6-bb0f-d0fe21a82053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:57.710241 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f12cfb-2618-46a6-bb0f-d0fe21a82053 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:57.719957 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1396/2801] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:22:58.018840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f069574-0eb5-4ca6-8150-9ec789254faf None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:58.020804 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9f069574-0eb5-4ca6-8150-9ec789254faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:58.034305 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f069574-0eb5-4ca6-8150-9ec789254faf None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:58.040182 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:58.041688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:58.041972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:58.042251 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] PATH_INFO: `/v3/projects/80044425991f4b76835621c883b8dcb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:58.043570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80044425991f4b76835621c883b8dcb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:58.045552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:58.094680 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80044425991f4b76835621c883b8dcb1', 'request_id': 'req-c0a982d5-975a-428b-a5d6-73f35e46dd58'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.100698 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80044425991f4b76835621c883b8dcb1', 'request_id': 'req-c0a982d5-975a-428b-a5d6-73f35e46dd58'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.110703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80044425991f4b76835621c883b8dcb1', 'request_id': 'req-c0a982d5-975a-428b-a5d6-73f35e46dd58'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.121779 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] The token cache is being invalidate because project 80044425991f4b76835621c883b8dcb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:22:58.122061 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.122663 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.124226 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1406/2802] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:22:58 2022] DELETE /identity/v3/projects/80044425991f4b76835621c883b8dcb1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:58.128303 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12cfb-2618-46a6-bb0f-d0fe21a82053 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:58.138678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12cfb-2618-46a6-bb0f-d0fe21a82053 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:58.201562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:58.202428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:58.202708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:58.202979 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] PATH_INFO: `/v3/users/b51a07f280714239b694206c68a3409a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:58.204199 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51a07f280714239b694206c68a3409a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:58.206174 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:58.255712 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51a07f280714239b694206c68a3409a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.262897 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51a07f280714239b694206c68a3409a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.263570 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51a07f280714239b694206c68a3409a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.272091 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51a07f280714239b694206c68a3409a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.284049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b9812fcb-e9b3-4a51-b627-c9489d917833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51a07f280714239b694206c68a3409a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.290150 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1397/2803] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:22:58 2022] DELETE /identity/v3/users/b51a07f280714239b694206c68a3409a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:58.572054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:58.573555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:58.586873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a982d5-975a-428b-a5d6-73f35e46dd58 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:58.652651 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:58.653566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:58.653845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:58.654125 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] PATH_INFO: `/v3/projects/4c7e41e93bdd4e4b86a4d5128433c85d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:58.655435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7e41e93bdd4e4b86a4d5128433c85d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:58.657387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:58.698383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:58.712547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7e41e93bdd4e4b86a4d5128433c85d', 'request_id': 'req-e644138e-be9a-4071-9fab-d44c8eda4b99'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.722033 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7e41e93bdd4e4b86a4d5128433c85d', 'request_id': 'req-e644138e-be9a-4071-9fab-d44c8eda4b99'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.734671 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7e41e93bdd4e4b86a4d5128433c85d', 'request_id': 'req-e644138e-be9a-4071-9fab-d44c8eda4b99'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.745491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] The token cache is being invalidate because project 4c7e41e93bdd4e4b86a4d5128433c85d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:22:58.745773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.746409 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e644138e-be9a-4071-9fab-d44c8eda4b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:22:58.748040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1407/2804] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:22:58 2022] DELETE /identity/v3/projects/4c7e41e93bdd4e4b86a4d5128433c85d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:58.755116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e84d73-d551-42f9-b5ae-c54bd8dab357 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:58.755627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e84d73-d551-42f9-b5ae-c54bd8dab357 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:58.755627 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e84d73-d551-42f9-b5ae-c54bd8dab357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:58.774663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b5e84d73-d551-42f9-b5ae-c54bd8dab357 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:58.775798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b5e84d73-d551-42f9-b5ae-c54bd8dab357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:58.829395 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:58.845618 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1398/2805] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:58.853800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f061bc3-9784-4b7f-a360-9cdde5b3eba7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:58.854079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f061bc3-9784-4b7f-a360-9cdde5b3eba7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:58.854353 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f061bc3-9784-4b7f-a360-9cdde5b3eba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:58.873744 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3f061bc3-9784-4b7f-a360-9cdde5b3eba7 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:58.874960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3f061bc3-9784-4b7f-a360-9cdde5b3eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:58.883928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1408/2806] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:58.889943 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e84d73-d551-42f9-b5ae-c54bd8dab357 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:58.901585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e84d73-d551-42f9-b5ae-c54bd8dab357 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:58.910735 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff794e-be1c-4ac5-a655-002ed6ff9272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:58.911686 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff794e-be1c-4ac5-a655-002ed6ff9272 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:58.912053 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff794e-be1c-4ac5-a655-002ed6ff9272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:58.912405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff794e-be1c-4ac5-a655-002ed6ff9272 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:58.913322 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff794e-be1c-4ac5-a655-002ed6ff9272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:22:58.913629 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff794e-be1c-4ac5-a655-002ed6ff9272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:58.915864 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff794e-be1c-4ac5-a655-002ed6ff9272 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:58.928471 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1399/2807] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:22:58.933347 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f061bc3-9784-4b7f-a360-9cdde5b3eba7 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:58.943100 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f061bc3-9784-4b7f-a360-9cdde5b3eba7 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:58.949432 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e354c-36ae-4e1e-a0cf-0ed9ee8130f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:58.950082 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e354c-36ae-4e1e-a0cf-0ed9ee8130f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:58.950342 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e354c-36ae-4e1e-a0cf-0ed9ee8130f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:58.950638 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e354c-36ae-4e1e-a0cf-0ed9ee8130f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:58.951331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e354c-36ae-4e1e-a0cf-0ed9ee8130f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:58.953245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e354c-36ae-4e1e-a0cf-0ed9ee8130f5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:58.988112 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1409/2808] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:22:58 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:22:58.994338 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff794e-be1c-4ac5-a655-002ed6ff9272 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.005178 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff794e-be1c-4ac5-a655-002ed6ff9272 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.067453 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681f3fb-1258-4a2f-9932-0a45d1b34690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.068070 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681f3fb-1258-4a2f-9932-0a45d1b34690 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.068349 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681f3fb-1258-4a2f-9932-0a45d1b34690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.068617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681f3fb-1258-4a2f-9932-0a45d1b34690 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.069342 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681f3fb-1258-4a2f-9932-0a45d1b34690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:59.071625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681f3fb-1258-4a2f-9932-0a45d1b34690 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:59.093880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1400/2809] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:22:58 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:22:59.099794 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e354c-36ae-4e1e-a0cf-0ed9ee8130f5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.110624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e354c-36ae-4e1e-a0cf-0ed9ee8130f5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.116494 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24a9dc-5513-4c73-bbc9-b46ae9fdf47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.117168 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24a9dc-5513-4c73-bbc9-b46ae9fdf47b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.117499 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24a9dc-5513-4c73-bbc9-b46ae9fdf47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.117773 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24a9dc-5513-4c73-bbc9-b46ae9fdf47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.118566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24a9dc-5513-4c73-bbc9-b46ae9fdf47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:59.120328 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24a9dc-5513-4c73-bbc9-b46ae9fdf47b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:59.131195 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1410/2810] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 15:22:59.135628 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681f3fb-1258-4a2f-9932-0a45d1b34690 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.146148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681f3fb-1258-4a2f-9932-0a45d1b34690 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.151844 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65951bd3-518f-4352-83ca-44f189ad5365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.152499 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65951bd3-518f-4352-83ca-44f189ad5365 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.152778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65951bd3-518f-4352-83ca-44f189ad5365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.153046 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65951bd3-518f-4352-83ca-44f189ad5365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.153797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65951bd3-518f-4352-83ca-44f189ad5365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:59.155400 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65951bd3-518f-4352-83ca-44f189ad5365 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:59.167970 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1401/2811] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:59.173474 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24a9dc-5513-4c73-bbc9-b46ae9fdf47b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.184944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24a9dc-5513-4c73-bbc9-b46ae9fdf47b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.189683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a4f05-f97f-42d7-839a-1bf5591b9f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.190570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a4f05-f97f-42d7-839a-1bf5591b9f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.190845 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a4f05-f97f-42d7-839a-1bf5591b9f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.191118 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a4f05-f97f-42d7-839a-1bf5591b9f4a admin admin] PATH_INFO: `/v3/projects/50321cacc35a454ba46969bfc22f8599/users/91d85f2599f6437ab34584e3002d55ac/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.205995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a4f05-f97f-42d7-839a-1bf5591b9f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50321cacc35a454ba46969bfc22f8599, user_id=91d85f2599f6437ab34584e3002d55ac, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:59.208625 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a4f05-f97f-42d7-839a-1bf5591b9f4a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:59.223586 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1411/2812] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:22:59 2022] PUT /identity/v3/projects/50321cacc35a454ba46969bfc22f8599/users/91d85f2599f6437ab34584e3002d55ac/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:59.233880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3855b-b35e-4433-89db-3429925aba84 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.234166 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3855b-b35e-4433-89db-3429925aba84 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.234439 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3855b-b35e-4433-89db-3429925aba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.261201 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-35f3855b-b35e-4433-89db-3429925aba84 None None] MFA Rules not processed for user `91d85f2599f6437ab34584e3002d55ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:59.262480 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-35f3855b-b35e-4433-89db-3429925aba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:59.329860 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1402/2813] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:59.334848 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a4f05-f97f-42d7-839a-1bf5591b9f4a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.396612 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a4f05-f97f-42d7-839a-1bf5591b9f4a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.402815 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6d9d6-9a8c-4d05-9726-0740aa34ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.403446 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6d9d6-9a8c-4d05-9726-0740aa34ec56 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.403725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6d9d6-9a8c-4d05-9726-0740aa34ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.403993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6d9d6-9a8c-4d05-9726-0740aa34ec56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.404673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6d9d6-9a8c-4d05-9726-0740aa34ec56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:59.406703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6d9d6-9a8c-4d05-9726-0740aa34ec56 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:59.440285 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1412/2814] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:22:59 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:22:59.445611 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3855b-b35e-4433-89db-3429925aba84 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.457833 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3855b-b35e-4433-89db-3429925aba84 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.506866 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:59.520224 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb9122-d321-4d58-bf92-2a420d6bc364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.520896 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb9122-d321-4d58-bf92-2a420d6bc364 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.521177 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb9122-d321-4d58-bf92-2a420d6bc364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.521486 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb9122-d321-4d58-bf92-2a420d6bc364 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.522167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb9122-d321-4d58-bf92-2a420d6bc364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:59.524106 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb9122-d321-4d58-bf92-2a420d6bc364 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:59.545681 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1403/2815] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:22:59 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:22:59.549925 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6d9d6-9a8c-4d05-9726-0740aa34ec56 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.560565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6d9d6-9a8c-4d05-9726-0740aa34ec56 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.565670 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c681eca-3e37-4efe-81e0-b1683e9e0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.566331 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c681eca-3e37-4efe-81e0-b1683e9e0c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.566610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c681eca-3e37-4efe-81e0-b1683e9e0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.566885 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c681eca-3e37-4efe-81e0-b1683e9e0c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.567632 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c681eca-3e37-4efe-81e0-b1683e9e0c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:59.569241 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c681eca-3e37-4efe-81e0-b1683e9e0c22 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:59.581694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1413/2816] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:59.585761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb9122-d321-4d58-bf92-2a420d6bc364 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.595998 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb9122-d321-4d58-bf92-2a420d6bc364 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.600654 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c92f1b-f96f-44b5-9467-4a33c98c90af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.601573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92f1b-f96f-44b5-9467-4a33c98c90af admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.601854 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92f1b-f96f-44b5-9467-4a33c98c90af admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.602133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92f1b-f96f-44b5-9467-4a33c98c90af admin admin] PATH_INFO: `/v3/projects/1095ed2a7a7b484db0684a6ed7324d0a/users/eb41315e0f604e3b96336e4c7035cf4b/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.617253 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c92f1b-f96f-44b5-9467-4a33c98c90af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1095ed2a7a7b484db0684a6ed7324d0a, user_id=eb41315e0f604e3b96336e4c7035cf4b, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:59.620437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c92f1b-f96f-44b5-9467-4a33c98c90af admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:59.635488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1404/2817] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:22:59 2022] PUT /identity/v3/projects/1095ed2a7a7b484db0684a6ed7324d0a/users/eb41315e0f604e3b96336e4c7035cf4b/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:59.639451 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c681eca-3e37-4efe-81e0-b1683e9e0c22 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.649639 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c681eca-3e37-4efe-81e0-b1683e9e0c22 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.679515 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:59.709493 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23d9a5-eb6d-42c5-9606-73d9ca5cb64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.710163 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d9a5-eb6d-42c5-9606-73d9ca5cb64c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.710440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d9a5-eb6d-42c5-9606-73d9ca5cb64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.710711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d9a5-eb6d-42c5-9606-73d9ca5cb64c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.711428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23d9a5-eb6d-42c5-9606-73d9ca5cb64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:59.713098 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23d9a5-eb6d-42c5-9606-73d9ca5cb64c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:59.722726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1414/2818] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:22:59.727056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c92f1b-f96f-44b5-9467-4a33c98c90af admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.738409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c92f1b-f96f-44b5-9467-4a33c98c90af admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.744030 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ad2be-34e2-42da-9d2a-cb3374ee4c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.744933 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ad2be-34e2-42da-9d2a-cb3374ee4c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.745186 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ad2be-34e2-42da-9d2a-cb3374ee4c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.745503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ad2be-34e2-42da-9d2a-cb3374ee4c0f admin admin] PATH_INFO: `/v3/projects/1095ed2a7a7b484db0684a6ed7324d0a/users/eb41315e0f604e3b96336e4c7035cf4b/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.747635 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ad2be-34e2-42da-9d2a-cb3374ee4c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1095ed2a7a7b484db0684a6ed7324d0a, user_id=eb41315e0f604e3b96336e4c7035cf4b, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:22:59.750319 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ad2be-34e2-42da-9d2a-cb3374ee4c0f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:22:59.763334 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1405/2819] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:22:59 2022] PUT /identity/v3/projects/1095ed2a7a7b484db0684a6ed7324d0a/users/eb41315e0f604e3b96336e4c7035cf4b/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:22:59.778452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727fc0-2156-45b6-bf6e-d8b2cbe021fb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.778763 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727fc0-2156-45b6-bf6e-d8b2cbe021fb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.779042 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727fc0-2156-45b6-bf6e-d8b2cbe021fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:22:59.807462 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-82727fc0-2156-45b6-bf6e-d8b2cbe021fb None None] MFA Rules not processed for user `eb41315e0f604e3b96336e4c7035cf4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:22:59.808694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-82727fc0-2156-45b6-bf6e-d8b2cbe021fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:59.884675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1415/2820] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:22:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:22:59.899148 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ad2be-34e2-42da-9d2a-cb3374ee4c0f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:22:59.901446 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-072ad2be-34e2-42da-9d2a-cb3374ee4c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:22:59.961930 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ad2be-34e2-42da-9d2a-cb3374ee4c0f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:22:59.966358 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c895b-2d3c-402b-ac2b-b7a4e557a821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:22:59.967007 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c895b-2d3c-402b-ac2b-b7a4e557a821 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:22:59.967293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c895b-2d3c-402b-ac2b-b7a4e557a821 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:22:59.967608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c895b-2d3c-402b-ac2b-b7a4e557a821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:00.027308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c895b-2d3c-402b-ac2b-b7a4e557a821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:00.028767 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c895b-2d3c-402b-ac2b-b7a4e557a821 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:00.038047 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1406/2821] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:22:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:04.285022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82727fc0-2156-45b6-bf6e-d8b2cbe021fb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:04.287632 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-82727fc0-2156-45b6-bf6e-d8b2cbe021fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:04.309076 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82727fc0-2156-45b6-bf6e-d8b2cbe021fb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:04.313767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f82c15-a09d-451d-991b-cee2b12c2390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:04.314421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f82c15-a09d-451d-991b-cee2b12c2390 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:04.314703 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f82c15-a09d-451d-991b-cee2b12c2390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:04.314979 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f82c15-a09d-451d-991b-cee2b12c2390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:04.326189 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f82c15-a09d-451d-991b-cee2b12c2390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:04.327630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f82c15-a09d-451d-991b-cee2b12c2390 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:04.337689 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1416/2822] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:09.283824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c895b-2d3c-402b-ac2b-b7a4e557a821 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:09.340619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:09.353625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c895b-2d3c-402b-ac2b-b7a4e557a821 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:09.359273 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:09.360381 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:09.360665 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:09.360942 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] PATH_INFO: `/v3/users/91d85f2599f6437ab34584e3002d55ac` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:09.362226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d85f2599f6437ab34584e3002d55ac)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:09.364161 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:09.414646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d85f2599f6437ab34584e3002d55ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:09.421571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d85f2599f6437ab34584e3002d55ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:09.422513 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d85f2599f6437ab34584e3002d55ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:09.431797 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d85f2599f6437ab34584e3002d55ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:09.444770 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d85f2599f6437ab34584e3002d55ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:09.451364 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1407/2823] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:23:09 2022] DELETE /identity/v3/users/91d85f2599f6437ab34584e3002d55ac => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:09.456213 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6f33-0a4c-47bc-b023-485a40d5a027 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:09.456739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6f33-0a4c-47bc-b023-485a40d5a027 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:09.456739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6f33-0a4c-47bc-b023-485a40d5a027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:09.475327 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-633b6f33-0a4c-47bc-b023-485a40d5a027 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:09.476510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-633b6f33-0a4c-47bc-b023-485a40d5a027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:09.551834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1417/2824] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:09.563748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:09.565356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:09.634869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207f45a-b7ac-4a0e-a860-7ab974bde111 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:09.639183 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee971643-db4c-469e-bc96-1bdeffe29306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:09.639835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee971643-db4c-469e-bc96-1bdeffe29306 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:09.640114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee971643-db4c-469e-bc96-1bdeffe29306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:09.640389 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee971643-db4c-469e-bc96-1bdeffe29306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:09.650169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee971643-db4c-469e-bc96-1bdeffe29306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:09.651639 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee971643-db4c-469e-bc96-1bdeffe29306 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:09.662200 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1408/2825] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:09.965699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b6f33-0a4c-47bc-b023-485a40d5a027 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:09.967473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-633b6f33-0a4c-47bc-b023-485a40d5a027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:09.986389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b6f33-0a4c-47bc-b023-485a40d5a027 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:09.991980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:09.993009 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:09.993187 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:09.993518 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] PATH_INFO: `/v3/projects/50321cacc35a454ba46969bfc22f8599` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:09.994739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50321cacc35a454ba46969bfc22f8599)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:09.996690 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:10.044830 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:10.056436 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50321cacc35a454ba46969bfc22f8599', 'request_id': 'req-f2616d64-f47d-45ac-a5d5-84ae57416ec4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.063113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50321cacc35a454ba46969bfc22f8599', 'request_id': 'req-f2616d64-f47d-45ac-a5d5-84ae57416ec4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.073565 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50321cacc35a454ba46969bfc22f8599', 'request_id': 'req-f2616d64-f47d-45ac-a5d5-84ae57416ec4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.086263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] The token cache is being invalidate because project 50321cacc35a454ba46969bfc22f8599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:23:10.086555 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.087193 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.088841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1418/2826] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:23:09 2022] DELETE /identity/v3/projects/50321cacc35a454ba46969bfc22f8599 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:10.093141 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee971643-db4c-469e-bc96-1bdeffe29306 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:10.103405 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee971643-db4c-469e-bc96-1bdeffe29306 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:10.173671 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:10.174576 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:10.174862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:10.175142 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] PATH_INFO: `/v3/users/eb41315e0f604e3b96336e4c7035cf4b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:10.176470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb41315e0f604e3b96336e4c7035cf4b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:10.178437 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:10.196238 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:10.229653 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb41315e0f604e3b96336e4c7035cf4b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.237299 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb41315e0f604e3b96336e4c7035cf4b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.238272 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb41315e0f604e3b96336e4c7035cf4b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.249619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb41315e0f604e3b96336e4c7035cf4b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.264008 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0cbbca9a-0a9a-4782-a944-32b778465bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb41315e0f604e3b96336e4c7035cf4b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.270523 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1409/2827] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:23:10 2022] DELETE /identity/v3/users/eb41315e0f604e3b96336e4c7035cf4b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:10.577434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:10.578926 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:10.597827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2616d64-f47d-45ac-a5d5-84ae57416ec4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:10.661334 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:10.662235 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:10.662540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:10.662980 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] PATH_INFO: `/v3/projects/1095ed2a7a7b484db0684a6ed7324d0a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:10.664211 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1095ed2a7a7b484db0684a6ed7324d0a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:10.666322 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:10.714725 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1095ed2a7a7b484db0684a6ed7324d0a', 'request_id': 'req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.720853 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1095ed2a7a7b484db0684a6ed7324d0a', 'request_id': 'req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.732013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1095ed2a7a7b484db0684a6ed7324d0a', 'request_id': 'req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.744574 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] The token cache is being invalidate because project 1095ed2a7a7b484db0684a6ed7324d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:23:10.744863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.745654 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-be1cd81c-99c2-4e88-9d27-7ae8584aaea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:10.747248 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1419/2828] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:23:10 2022] DELETE /identity/v3/projects/1095ed2a7a7b484db0684a6ed7324d0a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:10.753940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894edcf-09cd-4f20-bb14-07ed47e7914b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:10.754440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894edcf-09cd-4f20-bb14-07ed47e7914b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:10.754440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894edcf-09cd-4f20-bb14-07ed47e7914b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:10.775411 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5894edcf-09cd-4f20-bb14-07ed47e7914b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:10.776617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5894edcf-09cd-4f20-bb14-07ed47e7914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:10.841197 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1410/2829] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:10.850810 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94c13e-81f6-4881-9ba9-3dc78206c69d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:10.851091 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94c13e-81f6-4881-9ba9-3dc78206c69d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:10.851367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94c13e-81f6-4881-9ba9-3dc78206c69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:10.870548 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4b94c13e-81f6-4881-9ba9-3dc78206c69d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:10.871742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4b94c13e-81f6-4881-9ba9-3dc78206c69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:10.880851 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1420/2830] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:10.885255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894edcf-09cd-4f20-bb14-07ed47e7914b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:10.895228 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894edcf-09cd-4f20-bb14-07ed47e7914b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:10.900544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e031-cb26-4876-b6a3-5ab2c1d91090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:10.901266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e031-cb26-4876-b6a3-5ab2c1d91090 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:10.901569 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e031-cb26-4876-b6a3-5ab2c1d91090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:10.901842 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e031-cb26-4876-b6a3-5ab2c1d91090 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:10.902564 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34e031-cb26-4876-b6a3-5ab2c1d91090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:23:10.902867 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34e031-cb26-4876-b6a3-5ab2c1d91090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:10.904464 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34e031-cb26-4876-b6a3-5ab2c1d91090 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:10.917969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1411/2831] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:23:10.922464 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94c13e-81f6-4881-9ba9-3dc78206c69d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:10.932443 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94c13e-81f6-4881-9ba9-3dc78206c69d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:10.938012 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a810038-4ab3-4e6c-b400-e6364b769314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:10.938834 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810038-4ab3-4e6c-b400-e6364b769314 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:10.939088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810038-4ab3-4e6c-b400-e6364b769314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:10.939384 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810038-4ab3-4e6c-b400-e6364b769314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:10.940113 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a810038-4ab3-4e6c-b400-e6364b769314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:10.942040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a810038-4ab3-4e6c-b400-e6364b769314 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:10.970822 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1421/2832] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:23:10 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:23:10.975310 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e031-cb26-4876-b6a3-5ab2c1d91090 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:10.990169 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e031-cb26-4876-b6a3-5ab2c1d91090 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:11.055667 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d6aaf-555e-480f-bef7-b3a4a4ee5d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:11.056616 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6aaf-555e-480f-bef7-b3a4a4ee5d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:11.057018 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6aaf-555e-480f-bef7-b3a4a4ee5d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:11.057347 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6aaf-555e-480f-bef7-b3a4a4ee5d76 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:11.058393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d6aaf-555e-480f-bef7-b3a4a4ee5d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:11.061392 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d6aaf-555e-480f-bef7-b3a4a4ee5d76 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:11.091776 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1412/2833] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:23:10 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:23:11.097434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a810038-4ab3-4e6c-b400-e6364b769314 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:11.108181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a810038-4ab3-4e6c-b400-e6364b769314 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:11.113238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c0b76-a8c7-473b-ad4b-2719ddbfba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:11.113901 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c0b76-a8c7-473b-ad4b-2719ddbfba0c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:11.114183 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c0b76-a8c7-473b-ad4b-2719ddbfba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:11.114467 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c0b76-a8c7-473b-ad4b-2719ddbfba0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:11.115239 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c0b76-a8c7-473b-ad4b-2719ddbfba0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:11.116825 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c0b76-a8c7-473b-ad4b-2719ddbfba0c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:11.127627 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1422/2834] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:11.131913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d6aaf-555e-480f-bef7-b3a4a4ee5d76 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:11.143973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d6aaf-555e-480f-bef7-b3a4a4ee5d76 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:11.149537 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e8636-608f-4dd1-bc1f-250e2af7bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:11.150193 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8636-608f-4dd1-bc1f-250e2af7bcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:11.150473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8636-608f-4dd1-bc1f-250e2af7bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:11.150741 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8636-608f-4dd1-bc1f-250e2af7bcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:11.151465 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e8636-608f-4dd1-bc1f-250e2af7bcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:11.153052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e8636-608f-4dd1-bc1f-250e2af7bcf4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:11.158674 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:11.165404 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1413/2835] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:11.169929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c0b76-a8c7-473b-ad4b-2719ddbfba0c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:11.181423 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c0b76-a8c7-473b-ad4b-2719ddbfba0c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:11.186946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f8d5b-1c72-478d-8e63-3b4ef8abbd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:11.187860 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f8d5b-1c72-478d-8e63-3b4ef8abbd32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:11.188140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f8d5b-1c72-478d-8e63-3b4ef8abbd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:11.188454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f8d5b-1c72-478d-8e63-3b4ef8abbd32 admin admin] PATH_INFO: `/v3/projects/18c98605fe3545bbb67e377053c19047/users/22dc370b1e2f43f0999287566a8dbfc4/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:11.200879 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:11.207767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f8d5b-1c72-478d-8e63-3b4ef8abbd32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c98605fe3545bbb67e377053c19047, user_id=22dc370b1e2f43f0999287566a8dbfc4, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:11.210601 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f8d5b-1c72-478d-8e63-3b4ef8abbd32 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:11.226832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1423/2836] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:23:11 2022] PUT /identity/v3/projects/18c98605fe3545bbb67e377053c19047/users/22dc370b1e2f43f0999287566a8dbfc4/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:11.239167 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71384f-7f61-47e9-86a6-46424f12d26a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:11.239488 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71384f-7f61-47e9-86a6-46424f12d26a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:11.239869 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71384f-7f61-47e9-86a6-46424f12d26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:11.275128 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bc71384f-7f61-47e9-86a6-46424f12d26a None None] MFA Rules not processed for user `22dc370b1e2f43f0999287566a8dbfc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:11.276368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bc71384f-7f61-47e9-86a6-46424f12d26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:11.350772 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1414/2837] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:11.364180 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f8d5b-1c72-478d-8e63-3b4ef8abbd32 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:11.366280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7c5f8d5b-1c72-478d-8e63-3b4ef8abbd32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:11.427623 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f8d5b-1c72-478d-8e63-3b4ef8abbd32 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:11.432141 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5b223-c4bb-41e4-8eda-cbb6a09c7ba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:11.432823 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5b223-c4bb-41e4-8eda-cbb6a09c7ba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:11.433107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5b223-c4bb-41e4-8eda-cbb6a09c7ba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:11.433421 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5b223-c4bb-41e4-8eda-cbb6a09c7ba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:11.444160 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5b223-c4bb-41e4-8eda-cbb6a09c7ba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:11.445993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5b223-c4bb-41e4-8eda-cbb6a09c7ba6 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:11.456005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1424/2838] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:16.971737 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71384f-7f61-47e9-86a6-46424f12d26a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:17.039953 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71384f-7f61-47e9-86a6-46424f12d26a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:17.045549 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:17.046447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:17.046722 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:17.046992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] PATH_INFO: `/v3/users/22dc370b1e2f43f0999287566a8dbfc4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:17.048282 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] RBAC: Authorizing `identity:delete_user(user_id=22dc370b1e2f43f0999287566a8dbfc4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:17.050288 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:17.103778 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22dc370b1e2f43f0999287566a8dbfc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:17.110595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22dc370b1e2f43f0999287566a8dbfc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:17.111315 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22dc370b1e2f43f0999287566a8dbfc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:17.120713 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22dc370b1e2f43f0999287566a8dbfc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:17.133643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22dc370b1e2f43f0999287566a8dbfc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:17.139727 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1415/2839] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:23:16 2022] DELETE /identity/v3/users/22dc370b1e2f43f0999287566a8dbfc4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:17.145021 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6172035-90ec-43b0-8f7d-2d4738f8f2dd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:17.145531 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6172035-90ec-43b0-8f7d-2d4738f8f2dd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:17.145657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6172035-90ec-43b0-8f7d-2d4738f8f2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:17.165258 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f6172035-90ec-43b0-8f7d-2d4738f8f2dd None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:17.166535 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f6172035-90ec-43b0-8f7d-2d4738f8f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:17.244547 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1425/2840] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:17.256880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:17.258682 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:17.271393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:17.323256 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a264507-dc94-4ff2-9bdb-dba87330a30c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:17.333547 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6002ce-2365-4aaf-b805-59c3f9bffac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:17.334194 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6002ce-2365-4aaf-b805-59c3f9bffac8 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:17.334472 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6002ce-2365-4aaf-b805-59c3f9bffac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:17.334749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6002ce-2365-4aaf-b805-59c3f9bffac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:17.345041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6002ce-2365-4aaf-b805-59c3f9bffac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:17.346557 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6002ce-2365-4aaf-b805-59c3f9bffac8 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:17.356804 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1416/2841] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:17.895218 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6172035-90ec-43b0-8f7d-2d4738f8f2dd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:17.896795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f6172035-90ec-43b0-8f7d-2d4738f8f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:17.909481 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6172035-90ec-43b0-8f7d-2d4738f8f2dd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:17.915025 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:17.915928 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:17.916205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:17.916540 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] PATH_INFO: `/v3/projects/18c98605fe3545bbb67e377053c19047` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:17.917827 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c98605fe3545bbb67e377053c19047)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:17.919824 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:17.972598 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c98605fe3545bbb67e377053c19047', 'request_id': 'req-a711c210-f357-4496-abf2-1d5d4cc26d6f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:17.978726 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c98605fe3545bbb67e377053c19047', 'request_id': 'req-a711c210-f357-4496-abf2-1d5d4cc26d6f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:17.988730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c98605fe3545bbb67e377053c19047', 'request_id': 'req-a711c210-f357-4496-abf2-1d5d4cc26d6f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:18.000324 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] The token cache is being invalidate because project 18c98605fe3545bbb67e377053c19047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:23:18.000589 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:18.001700 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a711c210-f357-4496-abf2-1d5d4cc26d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:18.003268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1426/2842] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:23:17 2022] DELETE /identity/v3/projects/18c98605fe3545bbb67e377053c19047 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:18.008350 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48762-f2bd-401e-8d64-c136c13a6a48 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.008889 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48762-f2bd-401e-8d64-c136c13a6a48 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.009014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48762-f2bd-401e-8d64-c136c13a6a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.029071 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-65c48762-f2bd-401e-8d64-c136c13a6a48 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:18.030447 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-65c48762-f2bd-401e-8d64-c136c13a6a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:18.093330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1417/2843] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:23:18.101396 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990265d-d384-4e49-8eee-5f662742242b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.101688 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990265d-d384-4e49-8eee-5f662742242b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.101968 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990265d-d384-4e49-8eee-5f662742242b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.123222 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2990265d-d384-4e49-8eee-5f662742242b None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:18.124428 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2990265d-d384-4e49-8eee-5f662742242b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:18.133077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1427/2844] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:18.138096 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c48762-f2bd-401e-8d64-c136c13a6a48 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.150079 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c48762-f2bd-401e-8d64-c136c13a6a48 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.156014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126dd3c-5df0-4a23-8183-8197808986e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.156673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126dd3c-5df0-4a23-8183-8197808986e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.157133 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126dd3c-5df0-4a23-8183-8197808986e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.157316 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126dd3c-5df0-4a23-8183-8197808986e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.157971 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126dd3c-5df0-4a23-8183-8197808986e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:23:18.158281 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126dd3c-5df0-4a23-8183-8197808986e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.159888 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126dd3c-5df0-4a23-8183-8197808986e1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.172445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1418/2845] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:23:18.177648 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990265d-d384-4e49-8eee-5f662742242b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.187386 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990265d-d384-4e49-8eee-5f662742242b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.193139 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd46dc7-3c39-4178-a7c9-e142b0a4890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.193819 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd46dc7-3c39-4178-a7c9-e142b0a4890c admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.194107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd46dc7-3c39-4178-a7c9-e142b0a4890c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.194388 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd46dc7-3c39-4178-a7c9-e142b0a4890c admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.195402 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd46dc7-3c39-4178-a7c9-e142b0a4890c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.197326 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd46dc7-3c39-4178-a7c9-e142b0a4890c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.201581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:18.226517 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1428/2846] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:23:18 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:23:18.230992 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126dd3c-5df0-4a23-8183-8197808986e1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.241973 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126dd3c-5df0-4a23-8183-8197808986e1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.308064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328411-32bf-4e81-abb7-a5f2ea3429e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.308734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328411-32bf-4e81-abb7-a5f2ea3429e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.309014 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328411-32bf-4e81-abb7-a5f2ea3429e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.309332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328411-32bf-4e81-abb7-a5f2ea3429e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.310061 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e328411-32bf-4e81-abb7-a5f2ea3429e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.312001 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e328411-32bf-4e81-abb7-a5f2ea3429e8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.353362 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1419/2847] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:23:18 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:23:18.357259 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd46dc7-3c39-4178-a7c9-e142b0a4890c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.368582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd46dc7-3c39-4178-a7c9-e142b0a4890c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.375137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8b4f3-55f9-4d38-8703-f9b3d77b010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.376078 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b4f3-55f9-4d38-8703-f9b3d77b010f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.376553 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b4f3-55f9-4d38-8703-f9b3d77b010f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.376832 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b4f3-55f9-4d38-8703-f9b3d77b010f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.377607 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8b4f3-55f9-4d38-8703-f9b3d77b010f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.379242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8b4f3-55f9-4d38-8703-f9b3d77b010f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.390311 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1429/2848] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:18.395678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328411-32bf-4e81-abb7-a5f2ea3429e8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.407205 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328411-32bf-4e81-abb7-a5f2ea3429e8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.412949 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4df36-bc86-4059-aaf2-a5c73c7120f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.413634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4df36-bc86-4059-aaf2-a5c73c7120f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.413913 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4df36-bc86-4059-aaf2-a5c73c7120f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.414188 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4df36-bc86-4059-aaf2-a5c73c7120f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.414910 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4df36-bc86-4059-aaf2-a5c73c7120f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.416503 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4df36-bc86-4059-aaf2-a5c73c7120f0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.428969 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1420/2849] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:18.433093 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8b4f3-55f9-4d38-8703-f9b3d77b010f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.450268 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8b4f3-55f9-4d38-8703-f9b3d77b010f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.456533 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c52650-3db4-47b3-8a10-b8e854326038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.457463 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c52650-3db4-47b3-8a10-b8e854326038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.457737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c52650-3db4-47b3-8a10-b8e854326038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.457991 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c52650-3db4-47b3-8a10-b8e854326038 admin admin] PATH_INFO: `/v3/projects/917f0a36e08d49d6848c9604a042b3a7/users/43080d7dc4784bcbbc5a42ce15d91cf6/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.474264 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c52650-3db4-47b3-8a10-b8e854326038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917f0a36e08d49d6848c9604a042b3a7, user_id=43080d7dc4784bcbbc5a42ce15d91cf6, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.476916 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c52650-3db4-47b3-8a10-b8e854326038 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.493166 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1430/2850] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:23:18 2022] PUT /identity/v3/projects/917f0a36e08d49d6848c9604a042b3a7/users/43080d7dc4784bcbbc5a42ce15d91cf6/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:18.506852 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6cbd6-4987-416c-9d78-cea717f8722e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.507137 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6cbd6-4987-416c-9d78-cea717f8722e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.507416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6cbd6-4987-416c-9d78-cea717f8722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.537388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c1c6cbd6-4987-416c-9d78-cea717f8722e None None] MFA Rules not processed for user `43080d7dc4784bcbbc5a42ce15d91cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:18.538603 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c1c6cbd6-4987-416c-9d78-cea717f8722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:18.544055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:18.615287 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1421/2851] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:18.622295 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c52650-3db4-47b3-8a10-b8e854326038 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.687529 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c52650-3db4-47b3-8a10-b8e854326038 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.693476 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b9a44-8410-42d8-9656-96f8053b4c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.694172 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b9a44-8410-42d8-9656-96f8053b4c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.694454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b9a44-8410-42d8-9656-96f8053b4c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.694729 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b9a44-8410-42d8-9656-96f8053b4c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.695733 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b9a44-8410-42d8-9656-96f8053b4c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.697662 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b9a44-8410-42d8-9656-96f8053b4c33 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.730107 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1431/2852] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:23:18 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:23:18.736308 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6cbd6-4987-416c-9d78-cea717f8722e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.751862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6cbd6-4987-416c-9d78-cea717f8722e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.816093 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433ed40-0619-4907-b72f-b598108a7fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.816761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433ed40-0619-4907-b72f-b598108a7fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.817041 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433ed40-0619-4907-b72f-b598108a7fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.817348 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433ed40-0619-4907-b72f-b598108a7fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.818043 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433ed40-0619-4907-b72f-b598108a7fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.820271 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433ed40-0619-4907-b72f-b598108a7fc9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.848585 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1422/2853] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:23:18 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:23:18.852818 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b9a44-8410-42d8-9656-96f8053b4c33 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.863250 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b9a44-8410-42d8-9656-96f8053b4c33 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.868148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa84f7-fb05-4288-a985-15983d5d2cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.868738 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa84f7-fb05-4288-a985-15983d5d2cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.869015 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa84f7-fb05-4288-a985-15983d5d2cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.869316 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa84f7-fb05-4288-a985-15983d5d2cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.870063 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa84f7-fb05-4288-a985-15983d5d2cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.871677 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa84f7-fb05-4288-a985-15983d5d2cc1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.882352 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1432/2854] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:18.886552 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433ed40-0619-4907-b72f-b598108a7fc9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.897728 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433ed40-0619-4907-b72f-b598108a7fc9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.902631 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b617a2d-6fbb-4c03-96ec-3e9c2a63149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.903304 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617a2d-6fbb-4c03-96ec-3e9c2a63149b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.903579 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617a2d-6fbb-4c03-96ec-3e9c2a63149b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.903856 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617a2d-6fbb-4c03-96ec-3e9c2a63149b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.904584 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b617a2d-6fbb-4c03-96ec-3e9c2a63149b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.906234 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b617a2d-6fbb-4c03-96ec-3e9c2a63149b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.916382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1423/2855] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:18.922581 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa84f7-fb05-4288-a985-15983d5d2cc1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:18.937610 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa84f7-fb05-4288-a985-15983d5d2cc1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:18.943069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06181a9-b3a0-45db-9d73-12687e4d51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:18.943970 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06181a9-b3a0-45db-9d73-12687e4d51d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.944249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06181a9-b3a0-45db-9d73-12687e4d51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.944527 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06181a9-b3a0-45db-9d73-12687e4d51d6 admin admin] PATH_INFO: `/v3/projects/5101fa813b6542d4b380c8baabc132d6/users/11eb54efe7e14ee78886b14113a94e8a/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:18.960298 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06181a9-b3a0-45db-9d73-12687e4d51d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5101fa813b6542d4b380c8baabc132d6, user_id=11eb54efe7e14ee78886b14113a94e8a, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:18.963238 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06181a9-b3a0-45db-9d73-12687e4d51d6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:18.979944 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1433/2856] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:23:18 2022] PUT /identity/v3/projects/5101fa813b6542d4b380c8baabc132d6/users/11eb54efe7e14ee78886b14113a94e8a/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:18.991000 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10834e-90bd-405b-8cbf-e592e5ecf33d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:18.991459 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10834e-90bd-405b-8cbf-e592e5ecf33d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:18.991912 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10834e-90bd-405b-8cbf-e592e5ecf33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:19.022032 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5c10834e-90bd-405b-8cbf-e592e5ecf33d None None] MFA Rules not processed for user `11eb54efe7e14ee78886b14113a94e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:19.023266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5c10834e-90bd-405b-8cbf-e592e5ecf33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:19.105581 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1424/2857] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:19.111887 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06181a9-b3a0-45db-9d73-12687e4d51d6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:19.180387 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06181a9-b3a0-45db-9d73-12687e4d51d6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:19.185961 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc2d03-2a01-47ed-af6b-e4ba67245a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:19.186624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2d03-2a01-47ed-af6b-e4ba67245a2b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:19.186924 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2d03-2a01-47ed-af6b-e4ba67245a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:19.187197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2d03-2a01-47ed-af6b-e4ba67245a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:19.187884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc2d03-2a01-47ed-af6b-e4ba67245a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:19.190296 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc2d03-2a01-47ed-af6b-e4ba67245a2b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:19.194242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:19.218682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1434/2858] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:23:19 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:23:19.223642 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10834e-90bd-405b-8cbf-e592e5ecf33d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:19.234937 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10834e-90bd-405b-8cbf-e592e5ecf33d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:19.246962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:19.293783 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0062d3-d12b-4b3d-978d-080ef842173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:19.294473 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0062d3-d12b-4b3d-978d-080ef842173f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:19.294758 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0062d3-d12b-4b3d-978d-080ef842173f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:19.295034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0062d3-d12b-4b3d-978d-080ef842173f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:19.295733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0062d3-d12b-4b3d-978d-080ef842173f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:19.297725 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0062d3-d12b-4b3d-978d-080ef842173f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:19.320595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1425/2859] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:23:19 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 15:23:19.324869 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc2d03-2a01-47ed-af6b-e4ba67245a2b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:19.335473 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc2d03-2a01-47ed-af6b-e4ba67245a2b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:19.340583 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b02aad-fec3-4447-8759-c3ed4186f5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:19.341263 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b02aad-fec3-4447-8759-c3ed4186f5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:19.341577 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b02aad-fec3-4447-8759-c3ed4186f5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:19.341849 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b02aad-fec3-4447-8759-c3ed4186f5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:19.342686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b02aad-fec3-4447-8759-c3ed4186f5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:19.344300 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b02aad-fec3-4447-8759-c3ed4186f5d3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:19.355274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1435/2860] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:19.359416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0062d3-d12b-4b3d-978d-080ef842173f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:19.373922 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0062d3-d12b-4b3d-978d-080ef842173f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:19.379751 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3715e91-c1cc-4164-b789-4edb47f2a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:19.381332 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3715e91-c1cc-4164-b789-4edb47f2a545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:19.381586 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3715e91-c1cc-4164-b789-4edb47f2a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:19.381895 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3715e91-c1cc-4164-b789-4edb47f2a545 admin admin] PATH_INFO: `/v3/projects/5037e370a6e6488685517a3d85f2a419/users/51f0febd867b418a9a65b8a0411ea421/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:19.397706 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3715e91-c1cc-4164-b789-4edb47f2a545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5037e370a6e6488685517a3d85f2a419, user_id=51f0febd867b418a9a65b8a0411ea421, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:19.400398 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3715e91-c1cc-4164-b789-4edb47f2a545 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:19.416571 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1426/2861] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:23:19 2022] PUT /identity/v3/projects/5037e370a6e6488685517a3d85f2a419/users/51f0febd867b418a9a65b8a0411ea421/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:19.420682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b02aad-fec3-4447-8759-c3ed4186f5d3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:19.431770 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b02aad-fec3-4447-8759-c3ed4186f5d3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:19.500784 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9c1d8-b540-4585-a627-82d1901cf6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:19.501501 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9c1d8-b540-4585-a627-82d1901cf6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:19.501778 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9c1d8-b540-4585-a627-82d1901cf6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:19.502049 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9c1d8-b540-4585-a627-82d1901cf6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:19.502840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9c1d8-b540-4585-a627-82d1901cf6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:19.504626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9c1d8-b540-4585-a627-82d1901cf6f8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:19.515242 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1436/2862] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:19.520293 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3715e91-c1cc-4164-b789-4edb47f2a545 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:19.532252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3715e91-c1cc-4164-b789-4edb47f2a545 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:19.538940 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e5af-21fe-4e33-a921-22d12051e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:19.539825 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e5af-21fe-4e33-a921-22d12051e072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:19.540107 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e5af-21fe-4e33-a921-22d12051e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:19.540382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e5af-21fe-4e33-a921-22d12051e072 admin admin] PATH_INFO: `/v3/projects/5037e370a6e6488685517a3d85f2a419/users/51f0febd867b418a9a65b8a0411ea421/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:19.542708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e5af-21fe-4e33-a921-22d12051e072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5037e370a6e6488685517a3d85f2a419, user_id=51f0febd867b418a9a65b8a0411ea421, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:19.545393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e5af-21fe-4e33-a921-22d12051e072 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:19.556652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1427/2863] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:23:19 2022] PUT /identity/v3/projects/5037e370a6e6488685517a3d85f2a419/users/51f0febd867b418a9a65b8a0411ea421/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:19.628665 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eadf2f-2031-408c-a6fe-2613b69e134d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:19.628908 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eadf2f-2031-408c-a6fe-2613b69e134d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:19.629246 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eadf2f-2031-408c-a6fe-2613b69e134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:19.656426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-30eadf2f-2031-408c-a6fe-2613b69e134d None None] MFA Rules not processed for user `51f0febd867b418a9a65b8a0411ea421`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:19.657745 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-30eadf2f-2031-408c-a6fe-2613b69e134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:19.728653 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1437/2864] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:19.740744 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e5af-21fe-4e33-a921-22d12051e072 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:19.742573 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3464e5af-21fe-4e33-a921-22d12051e072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:19.808553 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e5af-21fe-4e33-a921-22d12051e072 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:19.812798 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fc282-5ea5-430f-b825-dd83601fecb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:19.814052 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fc282-5ea5-430f-b825-dd83601fecb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:19.814337 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fc282-5ea5-430f-b825-dd83601fecb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:19.814619 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fc282-5ea5-430f-b825-dd83601fecb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:19.872493 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fc282-5ea5-430f-b825-dd83601fecb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:19.873962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fc282-5ea5-430f-b825-dd83601fecb7 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:19.883005 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1428/2865] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:21.389842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eadf2f-2031-408c-a6fe-2613b69e134d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:21.391426 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-30eadf2f-2031-408c-a6fe-2613b69e134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:21.403914 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eadf2f-2031-408c-a6fe-2613b69e134d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:21.408753 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10fec3-2218-4404-97ab-a134b4939191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:21.409454 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10fec3-2218-4404-97ab-a134b4939191 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:21.409739 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10fec3-2218-4404-97ab-a134b4939191 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:21.410015 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10fec3-2218-4404-97ab-a134b4939191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:21.474319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:21.476934 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10fec3-2218-4404-97ab-a134b4939191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:21.478543 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10fec3-2218-4404-97ab-a134b4939191 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:21.489013 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1438/2866] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:22.059645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fc282-5ea5-430f-b825-dd83601fecb7 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:22.075244 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fc282-5ea5-430f-b825-dd83601fecb7 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:22.079739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8066f0-02bd-4fce-ae1e-668bb395cfbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cc8b94e9ba470ca1f620b7cbed8e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:22.080384 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8066f0-02bd-4fce-ae1e-668bb395cfbd service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:22.080658 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8066f0-02bd-4fce-ae1e-668bb395cfbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:22.080929 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8066f0-02bd-4fce-ae1e-668bb395cfbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:22.091313 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8066f0-02bd-4fce-ae1e-668bb395cfbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:22.092753 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8066f0-02bd-4fce-ae1e-668bb395cfbd service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:22.103416 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1429/2867] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:26.035450 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10fec3-2218-4404-97ab-a134b4939191 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:26.106841 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10fec3-2218-4404-97ab-a134b4939191 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:26.112767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:26.113682 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:26.113967 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:26.114245 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] PATH_INFO: `/v3/users/43080d7dc4784bcbbc5a42ce15d91cf6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:26.115582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=43080d7dc4784bcbbc5a42ce15d91cf6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:26.117556 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:26.168890 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43080d7dc4784bcbbc5a42ce15d91cf6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.175950 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43080d7dc4784bcbbc5a42ce15d91cf6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.176664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43080d7dc4784bcbbc5a42ce15d91cf6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.184465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43080d7dc4784bcbbc5a42ce15d91cf6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.185087 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43080d7dc4784bcbbc5a42ce15d91cf6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.202686 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1439/2868] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:23:26 2022] DELETE /identity/v3/users/43080d7dc4784bcbbc5a42ce15d91cf6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:26.207726 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db416f0-2546-4a4f-b921-407c51bf2a5a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:26.208211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db416f0-2546-4a4f-b921-407c51bf2a5a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:26.208211 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db416f0-2546-4a4f-b921-407c51bf2a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:26.226179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0db416f0-2546-4a4f-b921-407c51bf2a5a None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:26.227418 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0db416f0-2546-4a4f-b921-407c51bf2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:26.231831 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:26.296402 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1430/2869] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:26.307966 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:26.310484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:26.376863 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6ba2a-72c7-48a0-8ecd-789def806dea admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:26.381133 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8454d-d9ec-4c28-9029-321b372ec6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:26.381821 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8454d-d9ec-4c28-9029-321b372ec6df service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:26.382097 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8454d-d9ec-4c28-9029-321b372ec6df service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:26.382378 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8454d-d9ec-4c28-9029-321b372ec6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:26.391889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8454d-d9ec-4c28-9029-321b372ec6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:26.394120 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8454d-d9ec-4c28-9029-321b372ec6df service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:26.409931 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1440/2870] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:26.700414 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db416f0-2546-4a4f-b921-407c51bf2a5a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:26.701919 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0db416f0-2546-4a4f-b921-407c51bf2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:26.715356 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db416f0-2546-4a4f-b921-407c51bf2a5a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:26.720962 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:26.722695 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:26.722984 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:26.723266 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] PATH_INFO: `/v3/projects/917f0a36e08d49d6848c9604a042b3a7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:26.724578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=917f0a36e08d49d6848c9604a042b3a7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:26.726578 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:26.774246 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917f0a36e08d49d6848c9604a042b3a7', 'request_id': 'req-2a6ba193-5636-47b3-b569-edef43e4b405'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.780229 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917f0a36e08d49d6848c9604a042b3a7', 'request_id': 'req-2a6ba193-5636-47b3-b569-edef43e4b405'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.793255 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917f0a36e08d49d6848c9604a042b3a7', 'request_id': 'req-2a6ba193-5636-47b3-b569-edef43e4b405'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.804951 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] The token cache is being invalidate because project 917f0a36e08d49d6848c9604a042b3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:23:26.805226 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.805900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.807417 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1431/2871] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:23:26 2022] DELETE /identity/v3/projects/917f0a36e08d49d6848c9604a042b3a7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:26.811843 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8454d-d9ec-4c28-9029-321b372ec6df service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:26.822561 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8454d-d9ec-4c28-9029-321b372ec6df service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:26.835161 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:26.880883 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:26.881794 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:26.882070 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:26.882341 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] PATH_INFO: `/v3/users/11eb54efe7e14ee78886b14113a94e8a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:26.883585 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11eb54efe7e14ee78886b14113a94e8a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:26.885528 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:26.942201 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11eb54efe7e14ee78886b14113a94e8a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.951978 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11eb54efe7e14ee78886b14113a94e8a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.952777 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11eb54efe7e14ee78886b14113a94e8a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.964043 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11eb54efe7e14ee78886b14113a94e8a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.964999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11eb54efe7e14ee78886b14113a94e8a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:26.988137 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1441/2872] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:23:26 2022] DELETE /identity/v3/users/11eb54efe7e14ee78886b14113a94e8a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:27.281179 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:27.282768 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:27.297876 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ba193-5636-47b3-b569-edef43e4b405 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:27.359249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:27.360055 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:27.360331 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:27.360604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] PATH_INFO: `/v3/projects/5101fa813b6542d4b380c8baabc132d6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:27.362010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5101fa813b6542d4b380c8baabc132d6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:27.363961 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:27.407748 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:27.419324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5101fa813b6542d4b380c8baabc132d6', 'request_id': 'req-afa302f1-41b0-491e-a5f8-4d1216668804'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:27.425862 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5101fa813b6542d4b380c8baabc132d6', 'request_id': 'req-afa302f1-41b0-491e-a5f8-4d1216668804'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:27.436412 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5101fa813b6542d4b380c8baabc132d6', 'request_id': 'req-afa302f1-41b0-491e-a5f8-4d1216668804'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:27.448712 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] The token cache is being invalidate because project 5101fa813b6542d4b380c8baabc132d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:23:27.448966 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:27.449633 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:27.451170 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1432/2873] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:23:27 2022] DELETE /identity/v3/projects/5101fa813b6542d4b380c8baabc132d6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:27.455261 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:27.457022 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:27.471243 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc6a1-416d-48c7-88fc-39f71e899f03 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:27.536631 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:27.537552 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:27.537837 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:27.538114 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] PATH_INFO: `/v3/users/51f0febd867b418a9a65b8a0411ea421` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:27.539343 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f0febd867b418a9a65b8a0411ea421)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:27.541273 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:27.588434 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:27.595483 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f0febd867b418a9a65b8a0411ea421'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:27.603435 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f0febd867b418a9a65b8a0411ea421'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:27.604140 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f0febd867b418a9a65b8a0411ea421'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:27.612617 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f0febd867b418a9a65b8a0411ea421'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:27.613181 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82c7fbf2-aaf2-416b-b9ae-dc6099473109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f0febd867b418a9a65b8a0411ea421'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:27.631314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1442/2874] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:23:27 2022] DELETE /identity/v3/users/51f0febd867b418a9a65b8a0411ea421 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:27.923521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:27.925327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:27.943431 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa302f1-41b0-491e-a5f8-4d1216668804 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:28.011916 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:28.012826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.013063 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.013382 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] PATH_INFO: `/v3/projects/5037e370a6e6488685517a3d85f2a419` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.014631 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5037e370a6e6488685517a3d85f2a419)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:28.016562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:28.064739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5037e370a6e6488685517a3d85f2a419', 'request_id': 'req-930136fa-5a35-440f-881b-83e1d6c94a0f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:28.071993 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5037e370a6e6488685517a3d85f2a419', 'request_id': 'req-930136fa-5a35-440f-881b-83e1d6c94a0f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:28.081887 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5037e370a6e6488685517a3d85f2a419', 'request_id': 'req-930136fa-5a35-440f-881b-83e1d6c94a0f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:28.092704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] The token cache is being invalidate because project 5037e370a6e6488685517a3d85f2a419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:23:28.092983 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:28.093637 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-930136fa-5a35-440f-881b-83e1d6c94a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:23:28.095191 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1433/2875] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:23:27 2022] DELETE /identity/v3/projects/5037e370a6e6488685517a3d85f2a419 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:28.100800 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bfe68-9fcd-4915-a495-a654fac20097 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.101088 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bfe68-9fcd-4915-a495-a654fac20097 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.101417 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bfe68-9fcd-4915-a495-a654fac20097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.121108 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a23bfe68-9fcd-4915-a495-a654fac20097 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:28.122281 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a23bfe68-9fcd-4915-a495-a654fac20097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:28.186626 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1443/2876] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:23:28.194739 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aa3cc-4257-4e7a-a0a5-e10eb435281d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.195344 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aa3cc-4257-4e7a-a0a5-e10eb435281d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.195617 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aa3cc-4257-4e7a-a0a5-e10eb435281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.217268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-553aa3cc-4257-4e7a-a0a5-e10eb435281d None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:28.218509 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-553aa3cc-4257-4e7a-a0a5-e10eb435281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:28.228198 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1434/2877] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:28.232620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bfe68-9fcd-4915-a495-a654fac20097 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:28.242942 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bfe68-9fcd-4915-a495-a654fac20097 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:28.248695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed2ae6-3298-46e5-89d0-66dadcde9797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:28.249380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed2ae6-3298-46e5-89d0-66dadcde9797 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.249658 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed2ae6-3298-46e5-89d0-66dadcde9797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.249932 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed2ae6-3298-46e5-89d0-66dadcde9797 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.250645 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed2ae6-3298-46e5-89d0-66dadcde9797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 15:23:28.250948 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed2ae6-3298-46e5-89d0-66dadcde9797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:28.252630 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed2ae6-3298-46e5-89d0-66dadcde9797 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:28.264767 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1444/2878] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 17 15:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 15:23:28.270076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aa3cc-4257-4e7a-a0a5-e10eb435281d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:28.280324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aa3cc-4257-4e7a-a0a5-e10eb435281d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:28.286761 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf1ea2-e57b-4ed6-8e26-cc79d2a72d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:28.287408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf1ea2-e57b-4ed6-8e26-cc79d2a72d9a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.287707 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf1ea2-e57b-4ed6-8e26-cc79d2a72d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.287979 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf1ea2-e57b-4ed6-8e26-cc79d2a72d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.288675 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf1ea2-e57b-4ed6-8e26-cc79d2a72d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:28.290646 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf1ea2-e57b-4ed6-8e26-cc79d2a72d9a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:28.323064 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1435/2879] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:23:28 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:23:28.327380 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed2ae6-3298-46e5-89d0-66dadcde9797 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:28.337510 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed2ae6-3298-46e5-89d0-66dadcde9797 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:28.396657 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5049b7-fe17-45c2-a94f-b1138b9b1b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:28.397249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5049b7-fe17-45c2-a94f-b1138b9b1b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.397563 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5049b7-fe17-45c2-a94f-b1138b9b1b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.397842 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5049b7-fe17-45c2-a94f-b1138b9b1b5a admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.398512 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5049b7-fe17-45c2-a94f-b1138b9b1b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:28.400416 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5049b7-fe17-45c2-a94f-b1138b9b1b5a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:28.425624 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1445/2880] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:23:28 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:23:28.431393 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf1ea2-e57b-4ed6-8e26-cc79d2a72d9a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:28.442920 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf1ea2-e57b-4ed6-8e26-cc79d2a72d9a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:28.449092 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137a441-4ccf-4484-8281-7f9f1c737fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:28.449780 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a441-4ccf-4484-8281-7f9f1c737fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.450057 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a441-4ccf-4484-8281-7f9f1c737fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.450327 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a441-4ccf-4484-8281-7f9f1c737fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.451049 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137a441-4ccf-4484-8281-7f9f1c737fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:28.452648 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137a441-4ccf-4484-8281-7f9f1c737fc0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:28.464192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1436/2881] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:28.468379 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5049b7-fe17-45c2-a94f-b1138b9b1b5a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:28.478933 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5049b7-fe17-45c2-a94f-b1138b9b1b5a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:28.484060 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d23de-92c2-47e0-8b28-813e2140ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:28.484714 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d23de-92c2-47e0-8b28-813e2140ef8d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.484995 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d23de-92c2-47e0-8b28-813e2140ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.485439 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d23de-92c2-47e0-8b28-813e2140ef8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.486370 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d23de-92c2-47e0-8b28-813e2140ef8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:28.487838 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d23de-92c2-47e0-8b28-813e2140ef8d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:28.501873 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1446/2882] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:28.506260 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137a441-4ccf-4484-8281-7f9f1c737fc0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:28.516824 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137a441-4ccf-4484-8281-7f9f1c737fc0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:28.522835 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0a133-6f18-49e1-8e5f-548223361d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:28.523749 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0a133-6f18-49e1-8e5f-548223361d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.524027 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0a133-6f18-49e1-8e5f-548223361d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.524324 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0a133-6f18-49e1-8e5f-548223361d2b admin admin] PATH_INFO: `/v3/projects/036d78b4c1ae4bd69a1e0424602ef243/users/e8cfed782f004f1aa4aaa465c69afc6b/roles/2b2ea3ada01041ad941dd5b6721df5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.535819 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:28.540311 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0a133-6f18-49e1-8e5f-548223361d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=036d78b4c1ae4bd69a1e0424602ef243, user_id=e8cfed782f004f1aa4aaa465c69afc6b, role_id=2b2ea3ada01041ad941dd5b6721df5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:28.543656 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0a133-6f18-49e1-8e5f-548223361d2b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:28.558698 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1437/2883] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:23:28 2022] PUT /identity/v3/projects/036d78b4c1ae4bd69a1e0424602ef243/users/e8cfed782f004f1aa4aaa465c69afc6b/roles/2b2ea3ada01041ad941dd5b6721df5b2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:28.563875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aec354-9735-439b-80a2-8f33f21bb278 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.564165 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aec354-9735-439b-80a2-8f33f21bb278 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.564442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aec354-9735-439b-80a2-8f33f21bb278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.584699 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-06aec354-9735-439b-80a2-8f33f21bb278 None None] MFA Rules not processed for user `a2fa31ddd5e14c2dba5028b21c5db486`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:28.585939 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-06aec354-9735-439b-80a2-8f33f21bb278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:28.603718 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:28.649383 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1447/2884] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 15:23:28.659259 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0a133-6f18-49e1-8e5f-548223361d2b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:28.661733 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0cb0a133-6f18-49e1-8e5f-548223361d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:28.724192 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0a133-6f18-49e1-8e5f-548223361d2b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:28.728562 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291c47d-a458-45d1-8ad7-a60177357407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:28.729202 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c47d-a458-45d1-8ad7-a60177357407 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:28.729515 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c47d-a458-45d1-8ad7-a60177357407 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:28.729791 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c47d-a458-45d1-8ad7-a60177357407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:28.739645 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291c47d-a458-45d1-8ad7-a60177357407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:28.741075 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291c47d-a458-45d1-8ad7-a60177357407 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:28.751223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1438/2885] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:32.709093 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6774c3-8339-46de-ad38-ee0d9a637c8f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:32.709675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6774c3-8339-46de-ad38-ee0d9a637c8f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:32.709675 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6774c3-8339-46de-ad38-ee0d9a637c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:32.739514 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2c6774c3-8339-46de-ad38-ee0d9a637c8f None None] MFA Rules not processed for user `e8cfed782f004f1aa4aaa465c69afc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:32.740749 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2c6774c3-8339-46de-ad38-ee0d9a637c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:32.810433 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1448/2886] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:32.815076 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291c47d-a458-45d1-8ad7-a60177357407 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:32.825433 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291c47d-a458-45d1-8ad7-a60177357407 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:32.831521 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce0535-f3cc-4f5b-b7e8-f9f5b39afa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:32.832268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce0535-f3cc-4f5b-b7e8-f9f5b39afa7e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:32.832544 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce0535-f3cc-4f5b-b7e8-f9f5b39afa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:32.832808 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce0535-f3cc-4f5b-b7e8-f9f5b39afa7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:32.833625 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce0535-f3cc-4f5b-b7e8-f9f5b39afa7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:32.838335 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce0535-f3cc-4f5b-b7e8-f9f5b39afa7e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:32.869558 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1439/2887] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 17 15:23:32 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:23:32.873419 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6774c3-8339-46de-ad38-ee0d9a637c8f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:32.884673 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6774c3-8339-46de-ad38-ee0d9a637c8f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:32.939874 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b745-7719-45d2-91cd-3169412449c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:32.940570 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b745-7719-45d2-91cd-3169412449c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:32.940847 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b745-7719-45d2-91cd-3169412449c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:32.941119 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b745-7719-45d2-91cd-3169412449c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:32.941886 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6b745-7719-45d2-91cd-3169412449c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:32.943737 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6b745-7719-45d2-91cd-3169412449c0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:32.965946 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1449/2888] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 17 15:23:32 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 15:23:32.970087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce0535-f3cc-4f5b-b7e8-f9f5b39afa7e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:32.981145 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce0535-f3cc-4f5b-b7e8-f9f5b39afa7e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:32.986501 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e75c68-ae07-4f46-b0b8-35e26d6d03fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:32.987321 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e75c68-ae07-4f46-b0b8-35e26d6d03fb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:32.987606 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e75c68-ae07-4f46-b0b8-35e26d6d03fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:32.987881 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e75c68-ae07-4f46-b0b8-35e26d6d03fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:32.988608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e75c68-ae07-4f46-b0b8-35e26d6d03fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:32.990268 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e75c68-ae07-4f46-b0b8-35e26d6d03fb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:33.001252 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1440/2889] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:33.005742 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b745-7719-45d2-91cd-3169412449c0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:33.018186 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b745-7719-45d2-91cd-3169412449c0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:33.023972 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1dbf6-7e65-4476-b47b-6bdea5855489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:33.024891 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1dbf6-7e65-4476-b47b-6bdea5855489 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:33.025167 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1dbf6-7e65-4476-b47b-6bdea5855489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:33.025484 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1dbf6-7e65-4476-b47b-6bdea5855489 admin admin] PATH_INFO: `/v3/projects/52c992df0d8c4c32bb373a0584d1f54f/users/ce33d6b287f54284a79fd912e5474a52/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:33.040567 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1dbf6-7e65-4476-b47b-6bdea5855489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c992df0d8c4c32bb373a0584d1f54f, user_id=ce33d6b287f54284a79fd912e5474a52, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:33.043262 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1dbf6-7e65-4476-b47b-6bdea5855489 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:33.057616 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1450/2890] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:23:33 2022] PUT /identity/v3/projects/52c992df0d8c4c32bb373a0584d1f54f/users/ce33d6b287f54284a79fd912e5474a52/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:33.061649 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e75c68-ae07-4f46-b0b8-35e26d6d03fb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:33.072409 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e75c68-ae07-4f46-b0b8-35e26d6d03fb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:33.134678 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5fa33-3a49-4db2-a14c-20a24d1598b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:33.135379 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5fa33-3a49-4db2-a14c-20a24d1598b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:33.135663 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5fa33-3a49-4db2-a14c-20a24d1598b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:33.135941 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5fa33-3a49-4db2-a14c-20a24d1598b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:33.136673 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5fa33-3a49-4db2-a14c-20a24d1598b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:33.138318 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5fa33-3a49-4db2-a14c-20a24d1598b2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:33.148614 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1441/2891] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 17 15:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 15:23:33.153425 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1dbf6-7e65-4476-b47b-6bdea5855489 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:33.167280 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1dbf6-7e65-4476-b47b-6bdea5855489 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:33.175441 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8d1e0-ecef-4492-993d-7e68d21bed92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:33.176367 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8d1e0-ecef-4492-993d-7e68d21bed92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:33.176649 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8d1e0-ecef-4492-993d-7e68d21bed92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:33.176919 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8d1e0-ecef-4492-993d-7e68d21bed92 admin admin] PATH_INFO: `/v3/projects/52c992df0d8c4c32bb373a0584d1f54f/users/ce33d6b287f54284a79fd912e5474a52/roles/8a6fe5045159487aa0119348cfe94387` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:33.179084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8d1e0-ecef-4492-993d-7e68d21bed92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c992df0d8c4c32bb373a0584d1f54f, user_id=ce33d6b287f54284a79fd912e5474a52, role_id=8a6fe5045159487aa0119348cfe94387)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:33.181797 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8d1e0-ecef-4492-993d-7e68d21bed92 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:33.192884 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1451/2892] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 17 15:23:33 2022] PUT /identity/v3/projects/52c992df0d8c4c32bb373a0584d1f54f/users/ce33d6b287f54284a79fd912e5474a52/roles/8a6fe5045159487aa0119348cfe94387 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:23:37.452517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d099308-643d-48b3-bf78-ddfad9a7100c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:37.452517 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d099308-643d-48b3-bf78-ddfad9a7100c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:37.453116 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d099308-643d-48b3-bf78-ddfad9a7100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:37.502430 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1d099308-643d-48b3-bf78-ddfad9a7100c None None] MFA Rules not processed for user `ce33d6b287f54284a79fd912e5474a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:37.504355 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1d099308-643d-48b3-bf78-ddfad9a7100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:37.571390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:37.618630 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1442/2893] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:37.630085 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8d1e0-ecef-4492-993d-7e68d21bed92 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:37.631999 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c6f8d1e0-ecef-4492-993d-7e68d21bed92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:37.644575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:37.754960 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8d1e0-ecef-4492-993d-7e68d21bed92 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:37.760785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f3a9-49d5-4568-abbc-208adff2410e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:37.761711 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f3a9-49d5-4568-abbc-208adff2410e service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:37.762209 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f3a9-49d5-4568-abbc-208adff2410e service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:37.762566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f3a9-49d5-4568-abbc-208adff2410e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:37.841993 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2f3a9-49d5-4568-abbc-208adff2410e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:37.843890 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2f3a9-49d5-4568-abbc-208adff2410e service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:37.878318 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1452/2894] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:38.925101 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fd7ea-6a62-4946-8238-844a8b4e21e0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:38.925687 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fd7ea-6a62-4946-8238-844a8b4e21e0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:38.925816 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fd7ea-6a62-4946-8238-844a8b4e21e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:38.946837 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-991fd7ea-6a62-4946-8238-844a8b4e21e0 None None] MFA Rules not processed for user `e8cfed782f004f1aa4aaa465c69afc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:23:38.948080 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-991fd7ea-6a62-4946-8238-844a8b4e21e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:38.956604 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1443/2895] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 17 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:23:47.855566 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=54 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:48.939960 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=12 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:51.861491 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f3a9-49d5-4568-abbc-208adff2410e service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:51.863274 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-55f2f3a9-49d5-4568-abbc-208adff2410e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:51.935413 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f3a9-49d5-4568-abbc-208adff2410e service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:51.942040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d182b44-405a-40e9-87ff-6af41467d3a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:51.943008 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d182b44-405a-40e9-87ff-6af41467d3a3 service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:51.943340 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d182b44-405a-40e9-87ff-6af41467d3a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:51.943759 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d182b44-405a-40e9-87ff-6af41467d3a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:51.946877 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3d182b44-405a-40e9-87ff-6af41467d3a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:51.961795 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d182b44-405a-40e9-87ff-6af41467d3a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:51.963404 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d182b44-405a-40e9-87ff-6af41467d3a3 service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:51.974878 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1453/2896] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:54.060207 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fd7ea-6a62-4946-8238-844a8b4e21e0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:54.118440 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fd7ea-6a62-4946-8238-844a8b4e21e0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:54.122394 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3414-e2cd-458d-8e61-c09fb209a1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:54.123045 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3414-e2cd-458d-8e61-c09fb209a1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:54.123330 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3414-e2cd-458d-8e61-c09fb209a1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:54.123608 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3414-e2cd-458d-8e61-c09fb209a1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:54.125527 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c0e3414-e2cd-458d-8e61-c09fb209a1d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:54.135155 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e3414-e2cd-458d-8e61-c09fb209a1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:54.136594 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e3414-e2cd-458d-8e61-c09fb209a1d8 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:54.145010 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1444/2897] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:23:59.927875 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d182b44-405a-40e9-87ff-6af41467d3a3 service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:23:59.942339 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d182b44-405a-40e9-87ff-6af41467d3a3 service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:23:59.948813 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350dd8d-03db-48a6-9236-5afe98641c5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:23:59.949503 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350dd8d-03db-48a6-9236-5afe98641c5e service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:23:59.949785 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350dd8d-03db-48a6-9236-5afe98641c5e service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:23:59.950054 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350dd8d-03db-48a6-9236-5afe98641c5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:23:59.952016 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9350dd8d-03db-48a6-9236-5afe98641c5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:23:59.965442 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350dd8d-03db-48a6-9236-5afe98641c5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:23:59.967069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350dd8d-03db-48a6-9236-5afe98641c5e service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:23:59.978452 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1454/2898] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:23:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:24:03.156254 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3414-e2cd-458d-8e61-c09fb209a1d8 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:24:03.157988 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c0e3414-e2cd-458d-8e61-c09fb209a1d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:24:03.170106 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3414-e2cd-458d-8e61-c09fb209a1d8 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:24:03.175212 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838aae0-3e26-44a9-b7c8-bee0b0c078d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:24:03.176056 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838aae0-3e26-44a9-b7c8-bee0b0c078d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:24:03.176360 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838aae0-3e26-44a9-b7c8-bee0b0c078d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:24:03.176634 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838aae0-3e26-44a9-b7c8-bee0b0c078d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:24:03.187160 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838aae0-3e26-44a9-b7c8-bee0b0c078d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:24:03.188587 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838aae0-3e26-44a9-b7c8-bee0b0c078d3 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:24:03.198935 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1445/2899] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:24:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:24:05.104695 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350dd8d-03db-48a6-9236-5afe98641c5e service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:24:05.106302 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9350dd8d-03db-48a6-9236-5afe98641c5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:24:05.121150 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350dd8d-03db-48a6-9236-5afe98641c5e service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:24:05.127429 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02531340-a93b-459f-a1e1-faf6291fe7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11a9d339bb4e799dc4e5531147ddda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:24:05.128106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02531340-a93b-459f-a1e1-faf6291fe7e7 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:24:05.128389 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02531340-a93b-459f-a1e1-faf6291fe7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:24:05.128664 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02531340-a93b-459f-a1e1-faf6291fe7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:24:05.130525 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-02531340-a93b-459f-a1e1-faf6291fe7e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:24:05.143077 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02531340-a93b-459f-a1e1-faf6291fe7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:24:05.144620 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02531340-a93b-459f-a1e1-faf6291fe7e7 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:24:05.155466 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1455/2900] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:24:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:24:13.194736 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=32 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:24:15.151004 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=44 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:26:08.985135 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576136f-b9df-4a0e-8b71-5c5bdb511e84 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:26:08.985806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576136f-b9df-4a0e-8b71-5c5bdb511e84 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:26:08.985806 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576136f-b9df-4a0e-8b71-5c5bdb511e84 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:26:08.987388 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1446/2901] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:26:08.994069 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8eaa6-d2a0-4eb4-92a2-f8d486142c69 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:26:08.994694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8eaa6-d2a0-4eb4-92a2-f8d486142c69 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:26:08.994694 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8eaa6-d2a0-4eb4-92a2-f8d486142c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:26:09.085392 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0bd8eaa6-d2a0-4eb4-92a2-f8d486142c69 None None] MFA Rules not processed for user `20745118f9eb436096a323ba2d22e94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:26:09.086637 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0bd8eaa6-d2a0-4eb4-92a2-f8d486142c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:26:09.126148 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1456/2902] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:26:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:26:09.139470 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576136f-b9df-4a0e-8b71-5c5bdb511e84 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:26:09.150880 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576136f-b9df-4a0e-8b71-5c5bdb511e84 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:26:09.154877 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1482cd-720e-4cf9-bf8a-1f80d05491ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:26:09.155548 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1482cd-720e-4cf9-bf8a-1f80d05491ba service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:26:09.155826 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1482cd-720e-4cf9-bf8a-1f80d05491ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:26:09.156102 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1482cd-720e-4cf9-bf8a-1f80d05491ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:26:09.164034 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1482cd-720e-4cf9-bf8a-1f80d05491ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:26:09.165721 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1482cd-720e-4cf9-bf8a-1f80d05491ba service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:26:09.174704 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1447/2903] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:26:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:26:09.262532 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8e187-0a11-4f5d-a2c1-46cacb251419 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:26:09.262895 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8e187-0a11-4f5d-a2c1-46cacb251419 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:26:09.263173 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8e187-0a11-4f5d-a2c1-46cacb251419 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:26:09.264582 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1457/2904] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 17 15:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 15:26:09.270413 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab38968-69d3-473a-ba43-7cb2a0f87912 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:26:09.270708 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab38968-69d3-473a-ba43-7cb2a0f87912 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:26:09.270971 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab38968-69d3-473a-ba43-7cb2a0f87912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:26:09.311306 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bab38968-69d3-473a-ba43-7cb2a0f87912 None None] MFA Rules not processed for user `ca11a9d339bb4e799dc4e5531147ddda`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 15:26:09.312428 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bab38968-69d3-473a-ba43-7cb2a0f87912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:26:09.363223 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1448/2905] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 17 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 15:26:09.379197 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8e187-0a11-4f5d-a2c1-46cacb251419 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:26:09.394014 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8e187-0a11-4f5d-a2c1-46cacb251419 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:26:09.398730 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e67a-343e-421b-9d20-f1e233d3c0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20745118f9eb436096a323ba2d22e94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:26:09.399676 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e67a-343e-421b-9d20-f1e233d3c0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:26:09.400106 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e67a-343e-421b-9d20-f1e233d3c0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:26:09.400511 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e67a-343e-421b-9d20-f1e233d3c0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:26:09.414871 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43e67a-343e-421b-9d20-f1e233d3c0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:26:09.416929 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43e67a-343e-421b-9d20-f1e233d3c0c1 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:26:09.436194 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1458/2906] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:26:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:26:19.352249 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=27 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:26:19.424840 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=45 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:26:47.078711 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab38968-69d3-473a-ba43-7cb2a0f87912 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:26:47.080326 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bab38968-69d3-473a-ba43-7cb2a0f87912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:26:47.125429 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab38968-69d3-473a-ba43-7cb2a0f87912 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:26:47.132072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea01655-aa6e-4d80-aead-000182ae76d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:26:47.132734 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea01655-aa6e-4d80-aead-000182ae76d5 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:26:47.133015 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea01655-aa6e-4d80-aead-000182ae76d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:26:47.133320 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea01655-aa6e-4d80-aead-000182ae76d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:26:47.135436 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6ea01655-aa6e-4d80-aead-000182ae76d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:26:47.149158 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea01655-aa6e-4d80-aead-000182ae76d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:26:47.150900 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea01655-aa6e-4d80-aead-000182ae76d5 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:26:47.161730 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1449/2907] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:26:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:26:57.157347 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=15 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:27:40.775058 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e67a-343e-421b-9d20-f1e233d3c0c1 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:27:40.869335 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e67a-343e-421b-9d20-f1e233d3c0c1 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:27:40.874575 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:27:40.875537 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:27:40.875782 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:27:40.876084 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] PATH_INFO: `/v3/users/e8cfed782f004f1aa4aaa465c69afc6b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:27:40.877395 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cfed782f004f1aa4aaa465c69afc6b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:27:40.879314 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:27:40.928803 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cfed782f004f1aa4aaa465c69afc6b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:40.936319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cfed782f004f1aa4aaa465c69afc6b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:40.937005 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cfed782f004f1aa4aaa465c69afc6b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:40.945876 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cfed782f004f1aa4aaa465c69afc6b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:40.946440 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cfed782f004f1aa4aaa465c69afc6b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:40.963806 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1459/2908] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:27:40 2022] DELETE /identity/v3/users/e8cfed782f004f1aa4aaa465c69afc6b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:27:41.162243 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea01655-aa6e-4d80-aead-000182ae76d5 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:27:41.174390 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea01655-aa6e-4d80-aead-000182ae76d5 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:27:41.234792 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:27:41.235655 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:27:41.235934 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:27:41.236209 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] PATH_INFO: `/v3/projects/036d78b4c1ae4bd69a1e0424602ef243` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:27:41.237445 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=036d78b4c1ae4bd69a1e0424602ef243)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:27:41.239365 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:27:41.289765 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '036d78b4c1ae4bd69a1e0424602ef243', 'request_id': 'req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.296239 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '036d78b4c1ae4bd69a1e0424602ef243', 'request_id': 'req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.305372 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '036d78b4c1ae4bd69a1e0424602ef243', 'request_id': 'req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.329087 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] The token cache is being invalidate because project 036d78b4c1ae4bd69a1e0424602ef243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:27:41.329408 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.330072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.331615 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1450/2909] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:27:41 2022] DELETE /identity/v3/projects/036d78b4c1ae4bd69a1e0424602ef243 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:27:41.335900 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:27:41.337482 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:27:41.352103 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb2f26-318c-4f7e-b691-44d2b99b250e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:27:41.423072 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:27:41.423941 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:27:41.424231 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:27:41.424495 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] PATH_INFO: `/v3/users/ce33d6b287f54284a79fd912e5474a52` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:27:41.425780 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce33d6b287f54284a79fd912e5474a52)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:27:41.427768 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:27:41.430205 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:27:41.479291 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce33d6b287f54284a79fd912e5474a52'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.486683 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce33d6b287f54284a79fd912e5474a52'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.487361 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce33d6b287f54284a79fd912e5474a52'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.495580 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce33d6b287f54284a79fd912e5474a52'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.496465 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce33d6b287f54284a79fd912e5474a52'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.516040 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1460/2910] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 17 15:27:41 2022] DELETE /identity/v3/users/ce33d6b287f54284a79fd912e5474a52 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:27:41.703114 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:27:41.704801 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:27:41.718595 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd6a11-e161-4b2a-a21c-edf0ac3a8b40 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:27:41.781504 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fa31ddd5e14c2dba5028b21c5db486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2862ed4e06e54fce9d45a21ed40f7a44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:27:41.782368 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:27:41.786980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:27:41.786980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] PATH_INFO: `/v3/projects/52c992df0d8c4c32bb373a0584d1f54f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:27:41.786980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c992df0d8c4c32bb373a0584d1f54f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:27:41.786980 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:27:41.811752 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:27:41.838184 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c992df0d8c4c32bb373a0584d1f54f', 'request_id': 'req-3d2aa482-603c-490d-951f-8c0f4e134b48'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.844380 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c992df0d8c4c32bb373a0584d1f54f', 'request_id': 'req-3d2aa482-603c-490d-951f-8c0f4e134b48'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.852689 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c992df0d8c4c32bb373a0584d1f54f', 'request_id': 'req-3d2aa482-603c-490d-951f-8c0f4e134b48'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.863643 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] The token cache is being invalidate because project 52c992df0d8c4c32bb373a0584d1f54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 15:27:41.864004 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.864652 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d2aa482-603c-490d-951f-8c0f4e134b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 15:27:41.874072 dv-cinder-825492-23-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1451/2911] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 17 15:27:41 2022] DELETE /identity/v3/projects/52c992df0d8c4c32bb373a0584d1f54f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 15:27:51.512079 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:27:51.860396 dv-cinder-825492-23-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:31:54.019437 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 15:31:54.021130 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:31:54.096152 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e1768-dfc1-41fd-bfa2-53ea696c423c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 15:31:54.156592 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2028b-b22d-4a1b-852c-60fe2b0b089d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '328d0413dc65420c841b452f45c5b0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82df3e8cae9d4da0adb35aa5ed99e3ad', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 15:31:54.157249 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2028b-b22d-4a1b-852c-60fe2b0b089d service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 15:31:54.157549 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2028b-b22d-4a1b-852c-60fe2b0b089d service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 15:31:54.157822 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2028b-b22d-4a1b-852c-60fe2b0b089d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 15:31:54.159769 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e3c2028b-b22d-4a1b-852c-60fe2b0b089d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 15:31:54.171319 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2028b-b22d-4a1b-852c-60fe2b0b089d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 15:31:54.172889 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2028b-b22d-4a1b-852c-60fe2b0b089d service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 15:31:54.183204 dv-cinder-825492-23-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1461/2912] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 17 15:31:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 15:32:04.178902 dv-cinder-825492-23-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=58 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}